2023-07-12 18:14:05,315 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-07-12 18:14:05,578 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/908563f7-ecc5-f8cf-2e08-f8e1a8353ad0 2023-07-12 18:14:05,579 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobExportSnapshot timeout: 13 mins 2023-07-12 18:14:05,579 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobSecureExportSnapshot timeout: 13 mins 2023-07-12 18:14:05,623 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-12 18:14:05,934 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-12 18:14:05,935 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/908563f7-ecc5-f8cf-2e08-f8e1a8353ad0/cluster_816eff0a-2a97-4927-37b9-33079a1e6298, deleteOnExit=true 2023-07-12 18:14:05,935 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-12 18:14:05,936 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/908563f7-ecc5-f8cf-2e08-f8e1a8353ad0/test.cache.data in system properties and HBase conf 2023-07-12 18:14:05,937 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/908563f7-ecc5-f8cf-2e08-f8e1a8353ad0/hadoop.tmp.dir in system properties and HBase conf 2023-07-12 18:14:05,937 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/908563f7-ecc5-f8cf-2e08-f8e1a8353ad0/hadoop.log.dir in system properties and HBase conf 2023-07-12 18:14:05,938 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/908563f7-ecc5-f8cf-2e08-f8e1a8353ad0/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-12 18:14:05,938 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/908563f7-ecc5-f8cf-2e08-f8e1a8353ad0/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-12 18:14:05,938 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-12 18:14:06,328 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-12 18:14:06,335 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/908563f7-ecc5-f8cf-2e08-f8e1a8353ad0/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-12 18:14:06,336 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/908563f7-ecc5-f8cf-2e08-f8e1a8353ad0/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-12 18:14:06,337 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/908563f7-ecc5-f8cf-2e08-f8e1a8353ad0/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-12 18:14:06,337 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/908563f7-ecc5-f8cf-2e08-f8e1a8353ad0/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-12 18:14:06,337 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/908563f7-ecc5-f8cf-2e08-f8e1a8353ad0/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-12 18:14:06,338 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/908563f7-ecc5-f8cf-2e08-f8e1a8353ad0/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-12 18:14:06,339 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/908563f7-ecc5-f8cf-2e08-f8e1a8353ad0/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-12 18:14:06,339 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/908563f7-ecc5-f8cf-2e08-f8e1a8353ad0/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-12 18:14:06,340 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/908563f7-ecc5-f8cf-2e08-f8e1a8353ad0/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-12 18:14:06,340 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/908563f7-ecc5-f8cf-2e08-f8e1a8353ad0/nfs.dump.dir in system properties and HBase conf 2023-07-12 18:14:06,340 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/908563f7-ecc5-f8cf-2e08-f8e1a8353ad0/java.io.tmpdir in system properties and HBase conf 2023-07-12 18:14:06,341 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/908563f7-ecc5-f8cf-2e08-f8e1a8353ad0/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-12 18:14:06,341 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/908563f7-ecc5-f8cf-2e08-f8e1a8353ad0/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-12 18:14:06,342 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/908563f7-ecc5-f8cf-2e08-f8e1a8353ad0/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-12 18:14:07,046 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-12 18:14:07,053 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-12 18:14:07,434 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-12 18:14:07,658 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-12 18:14:07,688 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 18:14:07,738 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 18:14:07,780 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/908563f7-ecc5-f8cf-2e08-f8e1a8353ad0/java.io.tmpdir/Jetty_localhost_46055_hdfs____xpqr3s/webapp 2023-07-12 18:14:07,932 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46055 2023-07-12 18:14:07,979 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-12 18:14:07,979 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-12 18:14:08,496 WARN [Listener at localhost/38679] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-12 18:14:08,590 WARN [Listener at localhost/38679] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-12 18:14:08,613 WARN [Listener at localhost/38679] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 18:14:08,621 INFO [Listener at localhost/38679] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 18:14:08,627 INFO [Listener at localhost/38679] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/908563f7-ecc5-f8cf-2e08-f8e1a8353ad0/java.io.tmpdir/Jetty_localhost_34329_datanode____.sm0li8/webapp 2023-07-12 18:14:08,743 INFO [Listener at localhost/38679] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34329 2023-07-12 18:14:09,324 WARN [Listener at localhost/40741] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-12 18:14:09,390 WARN [Listener at localhost/40741] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-12 18:14:09,395 WARN [Listener at localhost/40741] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 18:14:09,397 INFO [Listener at localhost/40741] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 18:14:09,409 INFO [Listener at localhost/40741] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/908563f7-ecc5-f8cf-2e08-f8e1a8353ad0/java.io.tmpdir/Jetty_localhost_34645_datanode____.m5pmg3/webapp 2023-07-12 18:14:09,538 INFO [Listener at localhost/40741] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34645 2023-07-12 18:14:09,570 WARN [Listener at localhost/33979] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-12 18:14:09,625 WARN [Listener at localhost/33979] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-12 18:14:09,631 WARN [Listener at localhost/33979] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 18:14:09,633 INFO [Listener at localhost/33979] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 18:14:09,650 INFO [Listener at localhost/33979] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/908563f7-ecc5-f8cf-2e08-f8e1a8353ad0/java.io.tmpdir/Jetty_localhost_34547_datanode____e8h2ou/webapp 2023-07-12 18:14:09,806 INFO [Listener at localhost/33979] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34547 2023-07-12 18:14:09,830 WARN [Listener at localhost/42431] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-12 18:14:10,211 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x5ff373dbfcc32248: Processing first storage report for DS-9c5c1d9b-b0be-4e19-b908-515a4d4c341c from datanode c1a88c26-3802-4877-8256-4057a9bd8635 2023-07-12 18:14:10,214 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x5ff373dbfcc32248: from storage DS-9c5c1d9b-b0be-4e19-b908-515a4d4c341c node DatanodeRegistration(127.0.0.1:33353, datanodeUuid=c1a88c26-3802-4877-8256-4057a9bd8635, infoPort=43375, infoSecurePort=0, ipcPort=40741, storageInfo=lv=-57;cid=testClusterID;nsid=374886380;c=1689185647155), blocks: 0, hasStaleStorage: true, processing time: 3 msecs, invalidatedBlocks: 0 2023-07-12 18:14:10,214 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x3da3efef9c72b863: Processing first storage report for DS-873bdc4f-e346-41b8-a9fb-ef35b74e497c from datanode d5e16857-bda8-439e-a46a-adafb152d542 2023-07-12 18:14:10,214 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x3da3efef9c72b863: from storage DS-873bdc4f-e346-41b8-a9fb-ef35b74e497c node DatanodeRegistration(127.0.0.1:36781, datanodeUuid=d5e16857-bda8-439e-a46a-adafb152d542, infoPort=42403, infoSecurePort=0, ipcPort=42431, storageInfo=lv=-57;cid=testClusterID;nsid=374886380;c=1689185647155), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-12 18:14:10,216 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xfb5d1f867463354: Processing first storage report for DS-6879da17-d2e5-4c44-b37d-c26c6305c8fd from datanode 93a91c2e-dad5-4070-a9dd-d35693afaee2 2023-07-12 18:14:10,216 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xfb5d1f867463354: from storage DS-6879da17-d2e5-4c44-b37d-c26c6305c8fd node DatanodeRegistration(127.0.0.1:42247, datanodeUuid=93a91c2e-dad5-4070-a9dd-d35693afaee2, infoPort=43097, infoSecurePort=0, ipcPort=33979, storageInfo=lv=-57;cid=testClusterID;nsid=374886380;c=1689185647155), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-12 18:14:10,217 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x5ff373dbfcc32248: Processing first storage report for DS-a067b3e0-eec6-4ebb-bc05-62abdca7ad35 from datanode c1a88c26-3802-4877-8256-4057a9bd8635 2023-07-12 18:14:10,217 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x5ff373dbfcc32248: from storage DS-a067b3e0-eec6-4ebb-bc05-62abdca7ad35 node DatanodeRegistration(127.0.0.1:33353, datanodeUuid=c1a88c26-3802-4877-8256-4057a9bd8635, infoPort=43375, infoSecurePort=0, ipcPort=40741, storageInfo=lv=-57;cid=testClusterID;nsid=374886380;c=1689185647155), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-12 18:14:10,217 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x3da3efef9c72b863: Processing first storage report for DS-500c4d3b-708b-498b-8b1c-19339bdb0172 from datanode d5e16857-bda8-439e-a46a-adafb152d542 2023-07-12 18:14:10,217 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x3da3efef9c72b863: from storage DS-500c4d3b-708b-498b-8b1c-19339bdb0172 node DatanodeRegistration(127.0.0.1:36781, datanodeUuid=d5e16857-bda8-439e-a46a-adafb152d542, infoPort=42403, infoSecurePort=0, ipcPort=42431, storageInfo=lv=-57;cid=testClusterID;nsid=374886380;c=1689185647155), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-12 18:14:10,217 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xfb5d1f867463354: Processing first storage report for DS-6e68b6c2-0a55-4687-ab31-b6440ad5a659 from datanode 93a91c2e-dad5-4070-a9dd-d35693afaee2 2023-07-12 18:14:10,217 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xfb5d1f867463354: from storage DS-6e68b6c2-0a55-4687-ab31-b6440ad5a659 node DatanodeRegistration(127.0.0.1:42247, datanodeUuid=93a91c2e-dad5-4070-a9dd-d35693afaee2, infoPort=43097, infoSecurePort=0, ipcPort=33979, storageInfo=lv=-57;cid=testClusterID;nsid=374886380;c=1689185647155), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-12 18:14:10,483 DEBUG [Listener at localhost/42431] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/908563f7-ecc5-f8cf-2e08-f8e1a8353ad0 2023-07-12 18:14:10,585 INFO [Listener at localhost/42431] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/908563f7-ecc5-f8cf-2e08-f8e1a8353ad0/cluster_816eff0a-2a97-4927-37b9-33079a1e6298/zookeeper_0, clientPort=62122, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/908563f7-ecc5-f8cf-2e08-f8e1a8353ad0/cluster_816eff0a-2a97-4927-37b9-33079a1e6298/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/908563f7-ecc5-f8cf-2e08-f8e1a8353ad0/cluster_816eff0a-2a97-4927-37b9-33079a1e6298/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-12 18:14:10,612 INFO [Listener at localhost/42431] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=62122 2023-07-12 18:14:10,624 INFO [Listener at localhost/42431] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 18:14:10,626 INFO [Listener at localhost/42431] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 18:14:11,344 INFO [Listener at localhost/42431] util.FSUtils(471): Created version file at hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0 with version=8 2023-07-12 18:14:11,344 INFO [Listener at localhost/42431] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/hbase-staging 2023-07-12 18:14:11,739 INFO [Listener at localhost/42431] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-12 18:14:12,281 INFO [Listener at localhost/42431] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-07-12 18:14:12,320 INFO [Listener at localhost/42431] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 18:14:12,321 INFO [Listener at localhost/42431] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-12 18:14:12,321 INFO [Listener at localhost/42431] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-12 18:14:12,321 INFO [Listener at localhost/42431] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 18:14:12,322 INFO [Listener at localhost/42431] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-12 18:14:12,477 INFO [Listener at localhost/42431] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-12 18:14:12,558 DEBUG [Listener at localhost/42431] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-12 18:14:12,676 INFO [Listener at localhost/42431] ipc.NettyRpcServer(120): Bind to /172.31.14.131:43177 2023-07-12 18:14:12,692 INFO [Listener at localhost/42431] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 18:14:12,694 INFO [Listener at localhost/42431] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 18:14:12,718 INFO [Listener at localhost/42431] zookeeper.RecoverableZooKeeper(93): Process identifier=master:43177 connecting to ZooKeeper ensemble=127.0.0.1:62122 2023-07-12 18:14:12,787 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:431770x0, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-12 18:14:12,791 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:43177-0x1015abe0a7e0000 connected 2023-07-12 18:14:12,849 DEBUG [Listener at localhost/42431] zookeeper.ZKUtil(164): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-12 18:14:12,851 DEBUG [Listener at localhost/42431] zookeeper.ZKUtil(164): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 18:14:12,873 DEBUG [Listener at localhost/42431] zookeeper.ZKUtil(164): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-12 18:14:12,909 DEBUG [Listener at localhost/42431] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=43177 2023-07-12 18:14:12,910 DEBUG [Listener at localhost/42431] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=43177 2023-07-12 18:14:12,918 DEBUG [Listener at localhost/42431] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=43177 2023-07-12 18:14:12,922 DEBUG [Listener at localhost/42431] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=43177 2023-07-12 18:14:12,924 DEBUG [Listener at localhost/42431] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=43177 2023-07-12 18:14:12,932 INFO [Listener at localhost/42431] master.HMaster(444): hbase.rootdir=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0, hbase.cluster.distributed=false 2023-07-12 18:14:13,014 INFO [Listener at localhost/42431] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-12 18:14:13,015 INFO [Listener at localhost/42431] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 18:14:13,015 INFO [Listener at localhost/42431] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-12 18:14:13,015 INFO [Listener at localhost/42431] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-12 18:14:13,015 INFO [Listener at localhost/42431] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 18:14:13,015 INFO [Listener at localhost/42431] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-12 18:14:13,021 INFO [Listener at localhost/42431] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-12 18:14:13,025 INFO [Listener at localhost/42431] ipc.NettyRpcServer(120): Bind to /172.31.14.131:37689 2023-07-12 18:14:13,028 INFO [Listener at localhost/42431] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-12 18:14:13,035 INFO [Listener at localhost/42431] mob.MobFileCache(124): MobFileCache disabled 2023-07-12 18:14:13,037 INFO [Listener at localhost/42431] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 18:14:13,039 INFO [Listener at localhost/42431] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 18:14:13,042 INFO [Listener at localhost/42431] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:37689 connecting to ZooKeeper ensemble=127.0.0.1:62122 2023-07-12 18:14:13,049 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:376890x0, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-12 18:14:13,050 DEBUG [Listener at localhost/42431] zookeeper.ZKUtil(164): regionserver:376890x0, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-12 18:14:13,050 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:37689-0x1015abe0a7e0001 connected 2023-07-12 18:14:13,052 DEBUG [Listener at localhost/42431] zookeeper.ZKUtil(164): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 18:14:13,052 DEBUG [Listener at localhost/42431] zookeeper.ZKUtil(164): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-12 18:14:13,058 DEBUG [Listener at localhost/42431] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=37689 2023-07-12 18:14:13,058 DEBUG [Listener at localhost/42431] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=37689 2023-07-12 18:14:13,059 DEBUG [Listener at localhost/42431] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=37689 2023-07-12 18:14:13,061 DEBUG [Listener at localhost/42431] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=37689 2023-07-12 18:14:13,062 DEBUG [Listener at localhost/42431] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=37689 2023-07-12 18:14:13,088 INFO [Listener at localhost/42431] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-12 18:14:13,088 INFO [Listener at localhost/42431] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 18:14:13,089 INFO [Listener at localhost/42431] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-12 18:14:13,089 INFO [Listener at localhost/42431] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-12 18:14:13,090 INFO [Listener at localhost/42431] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 18:14:13,090 INFO [Listener at localhost/42431] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-12 18:14:13,090 INFO [Listener at localhost/42431] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-12 18:14:13,093 INFO [Listener at localhost/42431] ipc.NettyRpcServer(120): Bind to /172.31.14.131:34205 2023-07-12 18:14:13,093 INFO [Listener at localhost/42431] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-12 18:14:13,095 INFO [Listener at localhost/42431] mob.MobFileCache(124): MobFileCache disabled 2023-07-12 18:14:13,096 INFO [Listener at localhost/42431] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 18:14:13,100 INFO [Listener at localhost/42431] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 18:14:13,102 INFO [Listener at localhost/42431] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:34205 connecting to ZooKeeper ensemble=127.0.0.1:62122 2023-07-12 18:14:13,132 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:342050x0, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-12 18:14:13,133 DEBUG [Listener at localhost/42431] zookeeper.ZKUtil(164): regionserver:342050x0, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-12 18:14:13,134 DEBUG [Listener at localhost/42431] zookeeper.ZKUtil(164): regionserver:342050x0, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 18:14:13,137 DEBUG [Listener at localhost/42431] zookeeper.ZKUtil(164): regionserver:342050x0, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-12 18:14:13,139 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:34205-0x1015abe0a7e0002 connected 2023-07-12 18:14:13,139 DEBUG [Listener at localhost/42431] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=34205 2023-07-12 18:14:13,142 DEBUG [Listener at localhost/42431] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=34205 2023-07-12 18:14:13,143 DEBUG [Listener at localhost/42431] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=34205 2023-07-12 18:14:13,144 DEBUG [Listener at localhost/42431] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=34205 2023-07-12 18:14:13,144 DEBUG [Listener at localhost/42431] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=34205 2023-07-12 18:14:13,160 INFO [Listener at localhost/42431] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-12 18:14:13,160 INFO [Listener at localhost/42431] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 18:14:13,161 INFO [Listener at localhost/42431] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-12 18:14:13,161 INFO [Listener at localhost/42431] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-12 18:14:13,161 INFO [Listener at localhost/42431] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 18:14:13,161 INFO [Listener at localhost/42431] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-12 18:14:13,161 INFO [Listener at localhost/42431] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-12 18:14:13,163 INFO [Listener at localhost/42431] ipc.NettyRpcServer(120): Bind to /172.31.14.131:34493 2023-07-12 18:14:13,164 INFO [Listener at localhost/42431] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-12 18:14:13,165 INFO [Listener at localhost/42431] mob.MobFileCache(124): MobFileCache disabled 2023-07-12 18:14:13,167 INFO [Listener at localhost/42431] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 18:14:13,169 INFO [Listener at localhost/42431] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 18:14:13,170 INFO [Listener at localhost/42431] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:34493 connecting to ZooKeeper ensemble=127.0.0.1:62122 2023-07-12 18:14:13,178 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:344930x0, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-12 18:14:13,179 DEBUG [Listener at localhost/42431] zookeeper.ZKUtil(164): regionserver:344930x0, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-12 18:14:13,180 DEBUG [Listener at localhost/42431] zookeeper.ZKUtil(164): regionserver:344930x0, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 18:14:13,181 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:34493-0x1015abe0a7e0003 connected 2023-07-12 18:14:13,182 DEBUG [Listener at localhost/42431] zookeeper.ZKUtil(164): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-12 18:14:13,183 DEBUG [Listener at localhost/42431] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=34493 2023-07-12 18:14:13,183 DEBUG [Listener at localhost/42431] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=34493 2023-07-12 18:14:13,184 DEBUG [Listener at localhost/42431] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=34493 2023-07-12 18:14:13,186 DEBUG [Listener at localhost/42431] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=34493 2023-07-12 18:14:13,187 DEBUG [Listener at localhost/42431] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=34493 2023-07-12 18:14:13,190 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,43177,1689185651541 2023-07-12 18:14:13,199 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-12 18:14:13,201 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,43177,1689185651541 2023-07-12 18:14:13,231 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-12 18:14:13,231 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-12 18:14:13,231 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-12 18:14:13,231 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-12 18:14:13,232 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 18:14:13,233 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-12 18:14:13,237 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,43177,1689185651541 from backup master directory 2023-07-12 18:14:13,237 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-12 18:14:13,242 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,43177,1689185651541 2023-07-12 18:14:13,242 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-12 18:14:13,243 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-12 18:14:13,243 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,43177,1689185651541 2023-07-12 18:14:13,248 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-12 18:14:13,250 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-12 18:14:13,379 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/hbase.id with ID: 19fb2357-a54d-4146-8257-54c945c91d41 2023-07-12 18:14:13,442 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 18:14:13,466 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 18:14:13,557 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x40bdf078 to 127.0.0.1:62122 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 18:14:13,606 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@15ba9ae7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 18:14:13,641 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-12 18:14:13,644 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-12 18:14:13,665 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-12 18:14:13,665 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-12 18:14:13,668 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-12 18:14:13,672 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-12 18:14:13,673 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-12 18:14:13,711 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/MasterData/data/master/store-tmp 2023-07-12 18:14:13,769 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 18:14:13,769 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-12 18:14:13,770 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 18:14:13,770 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 18:14:13,770 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-12 18:14:13,770 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 18:14:13,770 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 18:14:13,770 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-12 18:14:13,775 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/MasterData/WALs/jenkins-hbase4.apache.org,43177,1689185651541 2023-07-12 18:14:13,799 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43177%2C1689185651541, suffix=, logDir=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/MasterData/WALs/jenkins-hbase4.apache.org,43177,1689185651541, archiveDir=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/MasterData/oldWALs, maxLogs=10 2023-07-12 18:14:13,880 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36781,DS-873bdc4f-e346-41b8-a9fb-ef35b74e497c,DISK] 2023-07-12 18:14:13,885 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33353,DS-9c5c1d9b-b0be-4e19-b908-515a4d4c341c,DISK] 2023-07-12 18:14:13,880 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42247,DS-6879da17-d2e5-4c44-b37d-c26c6305c8fd,DISK] 2023-07-12 18:14:13,893 DEBUG [RS-EventLoopGroup-5-3] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 18:14:13,982 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/MasterData/WALs/jenkins-hbase4.apache.org,43177,1689185651541/jenkins-hbase4.apache.org%2C43177%2C1689185651541.1689185653812 2023-07-12 18:14:13,983 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33353,DS-9c5c1d9b-b0be-4e19-b908-515a4d4c341c,DISK], DatanodeInfoWithStorage[127.0.0.1:42247,DS-6879da17-d2e5-4c44-b37d-c26c6305c8fd,DISK], DatanodeInfoWithStorage[127.0.0.1:36781,DS-873bdc4f-e346-41b8-a9fb-ef35b74e497c,DISK]] 2023-07-12 18:14:13,984 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-12 18:14:13,984 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 18:14:13,989 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-12 18:14:13,990 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-12 18:14:14,085 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-12 18:14:14,093 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-12 18:14:14,127 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-12 18:14:14,152 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 18:14:14,159 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-12 18:14:14,161 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-12 18:14:14,176 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-12 18:14:14,181 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 18:14:14,182 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66361199, jitterRate=-0.011141076683998108}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 18:14:14,183 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-12 18:14:14,184 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-12 18:14:14,208 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-12 18:14:14,208 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-12 18:14:14,211 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-12 18:14:14,213 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-12 18:14:14,256 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 43 msec 2023-07-12 18:14:14,257 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-12 18:14:14,289 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-12 18:14:14,295 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-12 18:14:14,320 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-12 18:14:14,325 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-12 18:14:14,327 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-12 18:14:14,333 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-12 18:14:14,337 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-12 18:14:14,341 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 18:14:14,343 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-12 18:14:14,343 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-12 18:14:14,358 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-12 18:14:14,363 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-12 18:14:14,364 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 18:14:14,364 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-12 18:14:14,364 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-12 18:14:14,366 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,43177,1689185651541, sessionid=0x1015abe0a7e0000, setting cluster-up flag (Was=false) 2023-07-12 18:14:14,370 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-12 18:14:14,397 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 18:14:14,402 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-12 18:14:14,404 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,43177,1689185651541 2023-07-12 18:14:14,410 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 18:14:14,417 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-12 18:14:14,419 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,43177,1689185651541 2023-07-12 18:14:14,423 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.hbase-snapshot/.tmp 2023-07-12 18:14:14,494 INFO [RS:1;jenkins-hbase4:34205] regionserver.HRegionServer(951): ClusterId : 19fb2357-a54d-4146-8257-54c945c91d41 2023-07-12 18:14:14,496 INFO [RS:0;jenkins-hbase4:37689] regionserver.HRegionServer(951): ClusterId : 19fb2357-a54d-4146-8257-54c945c91d41 2023-07-12 18:14:14,499 INFO [RS:2;jenkins-hbase4:34493] regionserver.HRegionServer(951): ClusterId : 19fb2357-a54d-4146-8257-54c945c91d41 2023-07-12 18:14:14,507 DEBUG [RS:2;jenkins-hbase4:34493] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-12 18:14:14,507 DEBUG [RS:0;jenkins-hbase4:37689] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-12 18:14:14,507 DEBUG [RS:1;jenkins-hbase4:34205] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-12 18:14:14,517 DEBUG [RS:0;jenkins-hbase4:37689] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-12 18:14:14,517 DEBUG [RS:0;jenkins-hbase4:37689] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-12 18:14:14,517 DEBUG [RS:1;jenkins-hbase4:34205] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-12 18:14:14,518 DEBUG [RS:1;jenkins-hbase4:34205] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-12 18:14:14,522 DEBUG [RS:2;jenkins-hbase4:34493] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-12 18:14:14,522 DEBUG [RS:2;jenkins-hbase4:34493] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-12 18:14:14,527 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-07-12 18:14:14,532 DEBUG [RS:0;jenkins-hbase4:37689] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-12 18:14:14,533 DEBUG [RS:1;jenkins-hbase4:34205] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-12 18:14:14,535 DEBUG [RS:2;jenkins-hbase4:34493] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-12 18:14:14,535 DEBUG [RS:0;jenkins-hbase4:37689] zookeeper.ReadOnlyZKClient(139): Connect 0x7b8bcf25 to 127.0.0.1:62122 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 18:14:14,536 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 18:14:14,536 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-07-12 18:14:14,535 DEBUG [RS:1;jenkins-hbase4:34205] zookeeper.ReadOnlyZKClient(139): Connect 0x3d682cdc to 127.0.0.1:62122 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 18:14:14,544 DEBUG [RS:2;jenkins-hbase4:34493] zookeeper.ReadOnlyZKClient(139): Connect 0x1a349d55 to 127.0.0.1:62122 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 18:14:14,570 DEBUG [RS:2;jenkins-hbase4:34493] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@14f36063, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 18:14:14,571 DEBUG [RS:2;jenkins-hbase4:34493] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@10ccf625, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-12 18:14:14,574 DEBUG [RS:0;jenkins-hbase4:37689] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@754c2e24, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 18:14:14,574 DEBUG [RS:0;jenkins-hbase4:37689] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7173a455, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-12 18:14:14,577 DEBUG [RS:1;jenkins-hbase4:34205] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@33afd501, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 18:14:14,577 DEBUG [RS:1;jenkins-hbase4:34205] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7292df3a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-12 18:14:14,605 DEBUG [RS:1;jenkins-hbase4:34205] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:34205 2023-07-12 18:14:14,607 DEBUG [RS:0;jenkins-hbase4:37689] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:37689 2023-07-12 18:14:14,613 DEBUG [RS:2;jenkins-hbase4:34493] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:34493 2023-07-12 18:14:14,618 INFO [RS:0;jenkins-hbase4:37689] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-12 18:14:14,619 INFO [RS:0;jenkins-hbase4:37689] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-12 18:14:14,618 INFO [RS:2;jenkins-hbase4:34493] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-12 18:14:14,619 INFO [RS:2;jenkins-hbase4:34493] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-12 18:14:14,618 INFO [RS:1;jenkins-hbase4:34205] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-12 18:14:14,619 DEBUG [RS:2;jenkins-hbase4:34493] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-12 18:14:14,619 INFO [RS:1;jenkins-hbase4:34205] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-12 18:14:14,619 DEBUG [RS:0;jenkins-hbase4:37689] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-12 18:14:14,620 DEBUG [RS:1;jenkins-hbase4:34205] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-12 18:14:14,621 INFO [RS:0;jenkins-hbase4:37689] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 18:14:14,621 DEBUG [RS:0;jenkins-hbase4:37689] regionserver.HRegionServer(1022): About to register with Master. 2023-07-12 18:14:14,621 INFO [RS:1;jenkins-hbase4:34205] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 18:14:14,621 DEBUG [RS:1;jenkins-hbase4:34205] regionserver.HRegionServer(1022): About to register with Master. 2023-07-12 18:14:14,625 INFO [RS:1;jenkins-hbase4:34205] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,43177,1689185651541 with isa=jenkins-hbase4.apache.org/172.31.14.131:34205, startcode=1689185653087 2023-07-12 18:14:14,625 INFO [RS:0;jenkins-hbase4:37689] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,43177,1689185651541 with isa=jenkins-hbase4.apache.org/172.31.14.131:37689, startcode=1689185653014 2023-07-12 18:14:14,620 INFO [RS:2;jenkins-hbase4:34493] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 18:14:14,627 DEBUG [RS:2;jenkins-hbase4:34493] regionserver.HRegionServer(1022): About to register with Master. 2023-07-12 18:14:14,628 INFO [RS:2;jenkins-hbase4:34493] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,43177,1689185651541 with isa=jenkins-hbase4.apache.org/172.31.14.131:34493, startcode=1689185653159 2023-07-12 18:14:14,658 DEBUG [RS:1;jenkins-hbase4:34205] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-12 18:14:14,658 DEBUG [RS:0;jenkins-hbase4:37689] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-12 18:14:14,666 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-12 18:14:14,670 DEBUG [RS:2;jenkins-hbase4:34493] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-12 18:14:14,720 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-12 18:14:14,721 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-12 18:14:14,721 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-12 18:14:14,721 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-12 18:14:14,721 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-07-12 18:14:14,721 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:14:14,721 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-12 18:14:14,721 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:14:14,751 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689185684751 2023-07-12 18:14:14,758 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-12 18:14:14,761 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-12 18:14:14,762 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-12 18:14:14,777 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-12 18:14:14,780 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-12 18:14:14,787 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-12 18:14:14,788 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-12 18:14:14,789 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-12 18:14:14,789 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-12 18:14:14,789 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37989, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-07-12 18:14:14,789 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59399, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-12 18:14:14,789 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54137, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-07-12 18:14:14,791 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-12 18:14:14,799 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-12 18:14:14,802 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-12 18:14:14,802 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-12 18:14:14,806 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-12 18:14:14,811 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-12 18:14:14,815 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689185654814,5,FailOnTimeoutGroup] 2023-07-12 18:14:14,817 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43177] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-12 18:14:14,818 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689185654815,5,FailOnTimeoutGroup] 2023-07-12 18:14:14,818 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-12 18:14:14,818 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-12 18:14:14,820 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-12 18:14:14,820 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-12 18:14:14,853 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43177] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:14:14,872 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43177] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:14:14,877 DEBUG [RS:0;jenkins-hbase4:37689] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0 2023-07-12 18:14:14,877 DEBUG [RS:0;jenkins-hbase4:37689] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:38679 2023-07-12 18:14:14,877 DEBUG [RS:0;jenkins-hbase4:37689] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-12 18:14:14,879 DEBUG [RS:1;jenkins-hbase4:34205] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0 2023-07-12 18:14:14,879 DEBUG [RS:1;jenkins-hbase4:34205] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:38679 2023-07-12 18:14:14,879 DEBUG [RS:1;jenkins-hbase4:34205] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-12 18:14:14,879 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-12 18:14:14,881 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-12 18:14:14,881 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0 2023-07-12 18:14:14,890 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-12 18:14:14,894 DEBUG [RS:0;jenkins-hbase4:37689] zookeeper.ZKUtil(162): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:14:14,896 DEBUG [RS:2;jenkins-hbase4:34493] regionserver.HRegionServer(2830): Master is not running yet 2023-07-12 18:14:14,894 DEBUG [RS:1;jenkins-hbase4:34205] zookeeper.ZKUtil(162): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:14:14,897 WARN [RS:2;jenkins-hbase4:34493] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-12 18:14:14,897 WARN [RS:0;jenkins-hbase4:37689] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-12 18:14:14,898 INFO [RS:0;jenkins-hbase4:37689] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-12 18:14:14,898 DEBUG [RS:0;jenkins-hbase4:37689] regionserver.HRegionServer(1948): logDir=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/WALs/jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:14:14,898 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,34205,1689185653087] 2023-07-12 18:14:14,898 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,37689,1689185653014] 2023-07-12 18:14:14,897 WARN [RS:1;jenkins-hbase4:34205] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-12 18:14:14,903 INFO [RS:1;jenkins-hbase4:34205] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-12 18:14:14,907 DEBUG [RS:1;jenkins-hbase4:34205] regionserver.HRegionServer(1948): logDir=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/WALs/jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:14:14,961 DEBUG [RS:1;jenkins-hbase4:34205] zookeeper.ZKUtil(162): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:14:14,962 DEBUG [RS:1;jenkins-hbase4:34205] zookeeper.ZKUtil(162): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:14:14,964 DEBUG [RS:0;jenkins-hbase4:37689] zookeeper.ZKUtil(162): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:14:14,965 DEBUG [RS:0;jenkins-hbase4:37689] zookeeper.ZKUtil(162): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:14:14,989 DEBUG [RS:0;jenkins-hbase4:37689] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-12 18:14:14,989 DEBUG [RS:1;jenkins-hbase4:34205] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-12 18:14:15,000 INFO [RS:2;jenkins-hbase4:34493] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,43177,1689185651541 with isa=jenkins-hbase4.apache.org/172.31.14.131:34493, startcode=1689185653159 2023-07-12 18:14:15,002 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43177] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:14:15,004 DEBUG [RS:2;jenkins-hbase4:34493] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0 2023-07-12 18:14:15,004 DEBUG [RS:2;jenkins-hbase4:34493] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:38679 2023-07-12 18:14:15,004 DEBUG [RS:2;jenkins-hbase4:34493] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-12 18:14:15,005 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 18:14:15,008 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-12 18:14:15,008 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-12 18:14:15,008 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-12 18:14:15,009 INFO [RS:0;jenkins-hbase4:37689] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-12 18:14:15,009 DEBUG [RS:2;jenkins-hbase4:34493] zookeeper.ZKUtil(162): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:14:15,009 WARN [RS:2;jenkins-hbase4:34493] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-12 18:14:15,009 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,34493,1689185653159] 2023-07-12 18:14:15,009 INFO [RS:2;jenkins-hbase4:34493] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-12 18:14:15,010 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:14:15,010 DEBUG [RS:2;jenkins-hbase4:34493] regionserver.HRegionServer(1948): logDir=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/WALs/jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:14:15,010 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-12 18:14:15,010 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:14:15,010 INFO [RS:1;jenkins-hbase4:34205] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-12 18:14:15,011 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:14:15,012 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:14:15,012 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:14:15,012 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:14:15,018 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/hbase/meta/1588230740/info 2023-07-12 18:14:15,019 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-12 18:14:15,021 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 18:14:15,021 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-12 18:14:15,023 DEBUG [RS:2;jenkins-hbase4:34493] zookeeper.ZKUtil(162): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:14:15,024 DEBUG [RS:2;jenkins-hbase4:34493] zookeeper.ZKUtil(162): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:14:15,025 DEBUG [RS:2;jenkins-hbase4:34493] zookeeper.ZKUtil(162): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:14:15,026 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/hbase/meta/1588230740/rep_barrier 2023-07-12 18:14:15,027 DEBUG [RS:2;jenkins-hbase4:34493] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-12 18:14:15,027 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-12 18:14:15,028 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 18:14:15,029 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-12 18:14:15,032 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/hbase/meta/1588230740/table 2023-07-12 18:14:15,035 INFO [RS:2;jenkins-hbase4:34493] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-12 18:14:15,048 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-12 18:14:15,056 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 18:14:15,058 INFO [RS:0;jenkins-hbase4:37689] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-12 18:14:15,083 INFO [RS:2;jenkins-hbase4:34493] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-12 18:14:15,084 INFO [RS:1;jenkins-hbase4:34205] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-12 18:14:15,086 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/hbase/meta/1588230740 2023-07-12 18:14:15,087 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/hbase/meta/1588230740 2023-07-12 18:14:15,087 INFO [RS:0;jenkins-hbase4:37689] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-12 18:14:15,087 INFO [RS:0;jenkins-hbase4:37689] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 18:14:15,095 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 18:14:15,097 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-12 18:14:15,087 INFO [RS:2;jenkins-hbase4:34493] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-12 18:14:15,092 INFO [RS:1;jenkins-hbase4:34205] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-12 18:14:15,108 INFO [RS:0;jenkins-hbase4:37689] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-12 18:14:15,108 INFO [RS:1;jenkins-hbase4:34205] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 18:14:15,108 INFO [RS:2;jenkins-hbase4:34493] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 18:14:15,110 INFO [RS:1;jenkins-hbase4:34205] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-12 18:14:15,111 INFO [RS:2;jenkins-hbase4:34493] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-12 18:14:15,112 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 18:14:15,114 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69677110, jitterRate=0.03826984763145447}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 18:14:15,114 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-12 18:14:15,115 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-12 18:14:15,115 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-12 18:14:15,115 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-12 18:14:15,115 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-12 18:14:15,115 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-12 18:14:15,121 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-12 18:14:15,121 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-12 18:14:15,130 INFO [RS:0;jenkins-hbase4:37689] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-12 18:14:15,130 INFO [RS:2;jenkins-hbase4:34493] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-12 18:14:15,130 DEBUG [RS:0;jenkins-hbase4:37689] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:14:15,130 INFO [RS:1;jenkins-hbase4:34205] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-12 18:14:15,131 DEBUG [RS:0;jenkins-hbase4:37689] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:14:15,131 DEBUG [RS:2;jenkins-hbase4:34493] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:14:15,131 DEBUG [RS:0;jenkins-hbase4:37689] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:14:15,131 DEBUG [RS:2;jenkins-hbase4:34493] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:14:15,131 DEBUG [RS:1;jenkins-hbase4:34205] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:14:15,132 DEBUG [RS:2;jenkins-hbase4:34493] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:14:15,132 DEBUG [RS:1;jenkins-hbase4:34205] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:14:15,132 DEBUG [RS:2;jenkins-hbase4:34493] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:14:15,132 DEBUG [RS:1;jenkins-hbase4:34205] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:14:15,132 DEBUG [RS:2;jenkins-hbase4:34493] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:14:15,132 DEBUG [RS:1;jenkins-hbase4:34205] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:14:15,132 DEBUG [RS:2;jenkins-hbase4:34493] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-12 18:14:15,132 DEBUG [RS:1;jenkins-hbase4:34205] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:14:15,132 DEBUG [RS:2;jenkins-hbase4:34493] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:14:15,132 DEBUG [RS:1;jenkins-hbase4:34205] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-12 18:14:15,132 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-12 18:14:15,132 DEBUG [RS:1;jenkins-hbase4:34205] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:14:15,131 DEBUG [RS:0;jenkins-hbase4:37689] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:14:15,132 DEBUG [RS:1;jenkins-hbase4:34205] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:14:15,132 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-12 18:14:15,133 DEBUG [RS:1;jenkins-hbase4:34205] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:14:15,132 DEBUG [RS:2;jenkins-hbase4:34493] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:14:15,133 DEBUG [RS:1;jenkins-hbase4:34205] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:14:15,133 DEBUG [RS:2;jenkins-hbase4:34493] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:14:15,133 DEBUG [RS:2;jenkins-hbase4:34493] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:14:15,133 DEBUG [RS:0;jenkins-hbase4:37689] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:14:15,133 DEBUG [RS:0;jenkins-hbase4:37689] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-12 18:14:15,133 DEBUG [RS:0;jenkins-hbase4:37689] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:14:15,134 DEBUG [RS:0;jenkins-hbase4:37689] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:14:15,134 DEBUG [RS:0;jenkins-hbase4:37689] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:14:15,134 DEBUG [RS:0;jenkins-hbase4:37689] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:14:15,147 INFO [RS:0;jenkins-hbase4:37689] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-12 18:14:15,147 INFO [RS:0;jenkins-hbase4:37689] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-12 18:14:15,147 INFO [RS:0;jenkins-hbase4:37689] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-12 18:14:15,153 INFO [RS:1;jenkins-hbase4:34205] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-12 18:14:15,154 INFO [RS:1;jenkins-hbase4:34205] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-12 18:14:15,154 INFO [RS:1;jenkins-hbase4:34205] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-12 18:14:15,154 INFO [RS:2;jenkins-hbase4:34493] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-12 18:14:15,194 INFO [RS:2;jenkins-hbase4:34493] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-12 18:14:15,195 INFO [RS:2;jenkins-hbase4:34493] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-12 18:14:15,195 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-12 18:14:15,209 INFO [RS:0;jenkins-hbase4:37689] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-12 18:14:15,213 INFO [RS:0;jenkins-hbase4:37689] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37689,1689185653014-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 18:14:15,220 INFO [RS:1;jenkins-hbase4:34205] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-12 18:14:15,221 INFO [RS:1;jenkins-hbase4:34205] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34205,1689185653087-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 18:14:15,213 INFO [RS:2;jenkins-hbase4:34493] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-12 18:14:15,227 INFO [RS:2;jenkins-hbase4:34493] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34493,1689185653159-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 18:14:15,244 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-12 18:14:15,253 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-12 18:14:15,255 INFO [RS:0;jenkins-hbase4:37689] regionserver.Replication(203): jenkins-hbase4.apache.org,37689,1689185653014 started 2023-07-12 18:14:15,255 INFO [RS:0;jenkins-hbase4:37689] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,37689,1689185653014, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:37689, sessionid=0x1015abe0a7e0001 2023-07-12 18:14:15,255 DEBUG [RS:0;jenkins-hbase4:37689] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-12 18:14:15,255 DEBUG [RS:0;jenkins-hbase4:37689] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:14:15,255 DEBUG [RS:0;jenkins-hbase4:37689] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,37689,1689185653014' 2023-07-12 18:14:15,255 DEBUG [RS:0;jenkins-hbase4:37689] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 18:14:15,256 DEBUG [RS:0;jenkins-hbase4:37689] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 18:14:15,257 DEBUG [RS:0;jenkins-hbase4:37689] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-12 18:14:15,257 DEBUG [RS:0;jenkins-hbase4:37689] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-12 18:14:15,257 DEBUG [RS:0;jenkins-hbase4:37689] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:14:15,257 DEBUG [RS:0;jenkins-hbase4:37689] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,37689,1689185653014' 2023-07-12 18:14:15,257 DEBUG [RS:0;jenkins-hbase4:37689] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:14:15,257 DEBUG [RS:0;jenkins-hbase4:37689] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:14:15,258 DEBUG [RS:0;jenkins-hbase4:37689] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-12 18:14:15,258 INFO [RS:0;jenkins-hbase4:37689] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-12 18:14:15,258 INFO [RS:0;jenkins-hbase4:37689] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-12 18:14:15,258 INFO [RS:1;jenkins-hbase4:34205] regionserver.Replication(203): jenkins-hbase4.apache.org,34205,1689185653087 started 2023-07-12 18:14:15,259 INFO [RS:1;jenkins-hbase4:34205] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,34205,1689185653087, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:34205, sessionid=0x1015abe0a7e0002 2023-07-12 18:14:15,259 DEBUG [RS:1;jenkins-hbase4:34205] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-12 18:14:15,259 DEBUG [RS:1;jenkins-hbase4:34205] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:14:15,260 DEBUG [RS:1;jenkins-hbase4:34205] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34205,1689185653087' 2023-07-12 18:14:15,261 DEBUG [RS:1;jenkins-hbase4:34205] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 18:14:15,261 DEBUG [RS:1;jenkins-hbase4:34205] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 18:14:15,262 INFO [RS:2;jenkins-hbase4:34493] regionserver.Replication(203): jenkins-hbase4.apache.org,34493,1689185653159 started 2023-07-12 18:14:15,262 INFO [RS:2;jenkins-hbase4:34493] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,34493,1689185653159, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:34493, sessionid=0x1015abe0a7e0003 2023-07-12 18:14:15,262 DEBUG [RS:1;jenkins-hbase4:34205] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-12 18:14:15,262 DEBUG [RS:2;jenkins-hbase4:34493] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-12 18:14:15,262 DEBUG [RS:1;jenkins-hbase4:34205] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-12 18:14:15,262 DEBUG [RS:2;jenkins-hbase4:34493] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:14:15,263 DEBUG [RS:2;jenkins-hbase4:34493] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34493,1689185653159' 2023-07-12 18:14:15,262 DEBUG [RS:1;jenkins-hbase4:34205] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:14:15,263 DEBUG [RS:2;jenkins-hbase4:34493] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 18:14:15,263 DEBUG [RS:1;jenkins-hbase4:34205] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34205,1689185653087' 2023-07-12 18:14:15,263 DEBUG [RS:1;jenkins-hbase4:34205] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:14:15,264 DEBUG [RS:2;jenkins-hbase4:34493] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 18:14:15,264 DEBUG [RS:1;jenkins-hbase4:34205] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:14:15,264 DEBUG [RS:2;jenkins-hbase4:34493] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-12 18:14:15,264 DEBUG [RS:2;jenkins-hbase4:34493] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-12 18:14:15,264 DEBUG [RS:2;jenkins-hbase4:34493] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:14:15,264 DEBUG [RS:2;jenkins-hbase4:34493] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34493,1689185653159' 2023-07-12 18:14:15,265 DEBUG [RS:2;jenkins-hbase4:34493] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:14:15,265 DEBUG [RS:1;jenkins-hbase4:34205] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-12 18:14:15,265 INFO [RS:1;jenkins-hbase4:34205] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-12 18:14:15,265 DEBUG [RS:2;jenkins-hbase4:34493] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:14:15,266 DEBUG [RS:2;jenkins-hbase4:34493] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-12 18:14:15,266 INFO [RS:2;jenkins-hbase4:34493] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-12 18:14:15,266 INFO [RS:2;jenkins-hbase4:34493] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-12 18:14:15,265 INFO [RS:1;jenkins-hbase4:34205] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-12 18:14:15,371 INFO [RS:1;jenkins-hbase4:34205] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C34205%2C1689185653087, suffix=, logDir=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/WALs/jenkins-hbase4.apache.org,34205,1689185653087, archiveDir=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/oldWALs, maxLogs=32 2023-07-12 18:14:15,372 INFO [RS:2;jenkins-hbase4:34493] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C34493%2C1689185653159, suffix=, logDir=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/WALs/jenkins-hbase4.apache.org,34493,1689185653159, archiveDir=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/oldWALs, maxLogs=32 2023-07-12 18:14:15,384 INFO [RS:0;jenkins-hbase4:37689] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C37689%2C1689185653014, suffix=, logDir=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/WALs/jenkins-hbase4.apache.org,37689,1689185653014, archiveDir=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/oldWALs, maxLogs=32 2023-07-12 18:14:15,412 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36781,DS-873bdc4f-e346-41b8-a9fb-ef35b74e497c,DISK] 2023-07-12 18:14:15,415 DEBUG [jenkins-hbase4:43177] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-07-12 18:14:15,428 DEBUG [jenkins-hbase4:43177] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-12 18:14:15,438 DEBUG [jenkins-hbase4:43177] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 18:14:15,438 DEBUG [jenkins-hbase4:43177] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 18:14:15,438 DEBUG [jenkins-hbase4:43177] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-12 18:14:15,438 DEBUG [jenkins-hbase4:43177] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 18:14:15,474 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36781,DS-873bdc4f-e346-41b8-a9fb-ef35b74e497c,DISK] 2023-07-12 18:14:15,475 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33353,DS-9c5c1d9b-b0be-4e19-b908-515a4d4c341c,DISK] 2023-07-12 18:14:15,475 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33353,DS-9c5c1d9b-b0be-4e19-b908-515a4d4c341c,DISK] 2023-07-12 18:14:15,476 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42247,DS-6879da17-d2e5-4c44-b37d-c26c6305c8fd,DISK] 2023-07-12 18:14:15,477 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42247,DS-6879da17-d2e5-4c44-b37d-c26c6305c8fd,DISK] 2023-07-12 18:14:15,523 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42247,DS-6879da17-d2e5-4c44-b37d-c26c6305c8fd,DISK] 2023-07-12 18:14:15,523 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36781,DS-873bdc4f-e346-41b8-a9fb-ef35b74e497c,DISK] 2023-07-12 18:14:15,523 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33353,DS-9c5c1d9b-b0be-4e19-b908-515a4d4c341c,DISK] 2023-07-12 18:14:15,525 INFO [RS:2;jenkins-hbase4:34493] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/WALs/jenkins-hbase4.apache.org,34493,1689185653159/jenkins-hbase4.apache.org%2C34493%2C1689185653159.1689185655377 2023-07-12 18:14:15,525 DEBUG [RS:2;jenkins-hbase4:34493] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36781,DS-873bdc4f-e346-41b8-a9fb-ef35b74e497c,DISK], DatanodeInfoWithStorage[127.0.0.1:33353,DS-9c5c1d9b-b0be-4e19-b908-515a4d4c341c,DISK], DatanodeInfoWithStorage[127.0.0.1:42247,DS-6879da17-d2e5-4c44-b37d-c26c6305c8fd,DISK]] 2023-07-12 18:14:15,532 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,34493,1689185653159, state=OPENING 2023-07-12 18:14:15,545 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-12 18:14:15,558 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 18:14:15,560 INFO [RS:1;jenkins-hbase4:34205] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/WALs/jenkins-hbase4.apache.org,34205,1689185653087/jenkins-hbase4.apache.org%2C34205%2C1689185653087.1689185655376 2023-07-12 18:14:15,566 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-12 18:14:15,566 DEBUG [RS:1;jenkins-hbase4:34205] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33353,DS-9c5c1d9b-b0be-4e19-b908-515a4d4c341c,DISK], DatanodeInfoWithStorage[127.0.0.1:42247,DS-6879da17-d2e5-4c44-b37d-c26c6305c8fd,DISK], DatanodeInfoWithStorage[127.0.0.1:36781,DS-873bdc4f-e346-41b8-a9fb-ef35b74e497c,DISK]] 2023-07-12 18:14:15,572 INFO [RS:0;jenkins-hbase4:37689] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/WALs/jenkins-hbase4.apache.org,37689,1689185653014/jenkins-hbase4.apache.org%2C37689%2C1689185653014.1689185655385 2023-07-12 18:14:15,573 DEBUG [RS:0;jenkins-hbase4:37689] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33353,DS-9c5c1d9b-b0be-4e19-b908-515a4d4c341c,DISK], DatanodeInfoWithStorage[127.0.0.1:36781,DS-873bdc4f-e346-41b8-a9fb-ef35b74e497c,DISK], DatanodeInfoWithStorage[127.0.0.1:42247,DS-6879da17-d2e5-4c44-b37d-c26c6305c8fd,DISK]] 2023-07-12 18:14:15,576 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,34493,1689185653159}] 2023-07-12 18:14:15,774 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:14:15,781 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-12 18:14:15,792 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60270, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-12 18:14:15,810 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-12 18:14:15,811 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-12 18:14:15,816 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C34493%2C1689185653159.meta, suffix=.meta, logDir=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/WALs/jenkins-hbase4.apache.org,34493,1689185653159, archiveDir=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/oldWALs, maxLogs=32 2023-07-12 18:14:15,838 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33353,DS-9c5c1d9b-b0be-4e19-b908-515a4d4c341c,DISK] 2023-07-12 18:14:15,843 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42247,DS-6879da17-d2e5-4c44-b37d-c26c6305c8fd,DISK] 2023-07-12 18:14:15,845 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36781,DS-873bdc4f-e346-41b8-a9fb-ef35b74e497c,DISK] 2023-07-12 18:14:15,855 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/WALs/jenkins-hbase4.apache.org,34493,1689185653159/jenkins-hbase4.apache.org%2C34493%2C1689185653159.meta.1689185655817.meta 2023-07-12 18:14:15,855 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33353,DS-9c5c1d9b-b0be-4e19-b908-515a4d4c341c,DISK], DatanodeInfoWithStorage[127.0.0.1:42247,DS-6879da17-d2e5-4c44-b37d-c26c6305c8fd,DISK], DatanodeInfoWithStorage[127.0.0.1:36781,DS-873bdc4f-e346-41b8-a9fb-ef35b74e497c,DISK]] 2023-07-12 18:14:15,856 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-12 18:14:15,859 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-07-12 18:14:15,860 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 18:14:15,861 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-12 18:14:15,864 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-12 18:14:15,865 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-12 18:14:15,879 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-12 18:14:15,879 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 18:14:15,879 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-12 18:14:15,879 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-12 18:14:15,884 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-12 18:14:15,887 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/hbase/meta/1588230740/info 2023-07-12 18:14:15,887 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/hbase/meta/1588230740/info 2023-07-12 18:14:15,888 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-12 18:14:15,890 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 18:14:15,890 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-12 18:14:15,892 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/hbase/meta/1588230740/rep_barrier 2023-07-12 18:14:15,892 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/hbase/meta/1588230740/rep_barrier 2023-07-12 18:14:15,892 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-12 18:14:15,893 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 18:14:15,894 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-12 18:14:15,895 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/hbase/meta/1588230740/table 2023-07-12 18:14:15,895 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/hbase/meta/1588230740/table 2023-07-12 18:14:15,896 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-12 18:14:15,897 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 18:14:15,899 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/hbase/meta/1588230740 2023-07-12 18:14:15,903 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/hbase/meta/1588230740 2023-07-12 18:14:15,908 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 18:14:15,911 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-12 18:14:15,913 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73537194, jitterRate=0.0957895815372467}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 18:14:15,917 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-12 18:14:15,932 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1689185655763 2023-07-12 18:14:15,960 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-12 18:14:15,962 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-12 18:14:15,963 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,34493,1689185653159, state=OPEN 2023-07-12 18:14:15,967 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-12 18:14:15,967 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-12 18:14:15,978 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-12 18:14:15,978 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,34493,1689185653159 in 392 msec 2023-07-12 18:14:16,011 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-12 18:14:16,011 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 785 msec 2023-07-12 18:14:16,019 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.4660 sec 2023-07-12 18:14:16,019 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1689185656019, completionTime=-1 2023-07-12 18:14:16,019 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-07-12 18:14:16,019 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-12 18:14:16,104 DEBUG [hconnection-0x30e4ce87-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 18:14:16,109 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60272, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 18:14:16,139 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-07-12 18:14:16,139 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689185716139 2023-07-12 18:14:16,139 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689185776139 2023-07-12 18:14:16,140 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 120 msec 2023-07-12 18:14:16,170 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43177,1689185651541-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 18:14:16,170 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43177,1689185651541-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-12 18:14:16,171 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43177,1689185651541-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-12 18:14:16,173 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:43177, period=300000, unit=MILLISECONDS is enabled. 2023-07-12 18:14:16,173 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-12 18:14:16,182 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-12 18:14:16,194 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-12 18:14:16,196 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-12 18:14:16,206 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-12 18:14:16,209 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 18:14:16,213 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 18:14:16,242 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/hbase/namespace/c9d13a2e32b182765840f6e1f06b1b0f 2023-07-12 18:14:16,246 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/hbase/namespace/c9d13a2e32b182765840f6e1f06b1b0f empty. 2023-07-12 18:14:16,247 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/hbase/namespace/c9d13a2e32b182765840f6e1f06b1b0f 2023-07-12 18:14:16,247 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-12 18:14:16,304 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-12 18:14:16,307 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => c9d13a2e32b182765840f6e1f06b1b0f, NAME => 'hbase:namespace,,1689185656195.c9d13a2e32b182765840f6e1f06b1b0f.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp 2023-07-12 18:14:16,364 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689185656195.c9d13a2e32b182765840f6e1f06b1b0f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 18:14:16,364 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing c9d13a2e32b182765840f6e1f06b1b0f, disabling compactions & flushes 2023-07-12 18:14:16,364 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689185656195.c9d13a2e32b182765840f6e1f06b1b0f. 2023-07-12 18:14:16,364 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689185656195.c9d13a2e32b182765840f6e1f06b1b0f. 2023-07-12 18:14:16,364 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689185656195.c9d13a2e32b182765840f6e1f06b1b0f. after waiting 0 ms 2023-07-12 18:14:16,365 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689185656195.c9d13a2e32b182765840f6e1f06b1b0f. 2023-07-12 18:14:16,365 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689185656195.c9d13a2e32b182765840f6e1f06b1b0f. 2023-07-12 18:14:16,365 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for c9d13a2e32b182765840f6e1f06b1b0f: 2023-07-12 18:14:16,371 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 18:14:16,389 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1689185656195.c9d13a2e32b182765840f6e1f06b1b0f.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689185656375"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689185656375"}]},"ts":"1689185656375"} 2023-07-12 18:14:16,421 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-12 18:14:16,425 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 18:14:16,432 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689185656426"}]},"ts":"1689185656426"} 2023-07-12 18:14:16,438 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-12 18:14:16,443 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-12 18:14:16,444 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 18:14:16,444 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 18:14:16,444 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-12 18:14:16,444 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 18:14:16,447 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=c9d13a2e32b182765840f6e1f06b1b0f, ASSIGN}] 2023-07-12 18:14:16,451 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=c9d13a2e32b182765840f6e1f06b1b0f, ASSIGN 2023-07-12 18:14:16,453 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=c9d13a2e32b182765840f6e1f06b1b0f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34493,1689185653159; forceNewPlan=false, retain=false 2023-07-12 18:14:16,606 INFO [jenkins-hbase4:43177] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-12 18:14:16,607 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=c9d13a2e32b182765840f6e1f06b1b0f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:14:16,608 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1689185656195.c9d13a2e32b182765840f6e1f06b1b0f.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689185656607"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689185656607"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689185656607"}]},"ts":"1689185656607"} 2023-07-12 18:14:16,615 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure c9d13a2e32b182765840f6e1f06b1b0f, server=jenkins-hbase4.apache.org,34493,1689185653159}] 2023-07-12 18:14:16,776 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1689185656195.c9d13a2e32b182765840f6e1f06b1b0f. 2023-07-12 18:14:16,776 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c9d13a2e32b182765840f6e1f06b1b0f, NAME => 'hbase:namespace,,1689185656195.c9d13a2e32b182765840f6e1f06b1b0f.', STARTKEY => '', ENDKEY => ''} 2023-07-12 18:14:16,777 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1689185656195.c9d13a2e32b182765840f6e1f06b1b0f. service=AccessControlService 2023-07-12 18:14:16,778 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 18:14:16,778 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace c9d13a2e32b182765840f6e1f06b1b0f 2023-07-12 18:14:16,778 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689185656195.c9d13a2e32b182765840f6e1f06b1b0f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 18:14:16,779 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c9d13a2e32b182765840f6e1f06b1b0f 2023-07-12 18:14:16,779 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c9d13a2e32b182765840f6e1f06b1b0f 2023-07-12 18:14:16,785 INFO [StoreOpener-c9d13a2e32b182765840f6e1f06b1b0f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region c9d13a2e32b182765840f6e1f06b1b0f 2023-07-12 18:14:16,788 DEBUG [StoreOpener-c9d13a2e32b182765840f6e1f06b1b0f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/hbase/namespace/c9d13a2e32b182765840f6e1f06b1b0f/info 2023-07-12 18:14:16,788 DEBUG [StoreOpener-c9d13a2e32b182765840f6e1f06b1b0f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/hbase/namespace/c9d13a2e32b182765840f6e1f06b1b0f/info 2023-07-12 18:14:16,788 INFO [StoreOpener-c9d13a2e32b182765840f6e1f06b1b0f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c9d13a2e32b182765840f6e1f06b1b0f columnFamilyName info 2023-07-12 18:14:16,789 INFO [StoreOpener-c9d13a2e32b182765840f6e1f06b1b0f-1] regionserver.HStore(310): Store=c9d13a2e32b182765840f6e1f06b1b0f/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 18:14:16,791 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/hbase/namespace/c9d13a2e32b182765840f6e1f06b1b0f 2023-07-12 18:14:16,793 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/hbase/namespace/c9d13a2e32b182765840f6e1f06b1b0f 2023-07-12 18:14:16,797 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c9d13a2e32b182765840f6e1f06b1b0f 2023-07-12 18:14:16,803 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/hbase/namespace/c9d13a2e32b182765840f6e1f06b1b0f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 18:14:16,804 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c9d13a2e32b182765840f6e1f06b1b0f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69490282, jitterRate=0.0354858934879303}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 18:14:16,804 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c9d13a2e32b182765840f6e1f06b1b0f: 2023-07-12 18:14:16,811 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1689185656195.c9d13a2e32b182765840f6e1f06b1b0f., pid=6, masterSystemTime=1689185656768 2023-07-12 18:14:16,815 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1689185656195.c9d13a2e32b182765840f6e1f06b1b0f. 2023-07-12 18:14:16,815 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1689185656195.c9d13a2e32b182765840f6e1f06b1b0f. 2023-07-12 18:14:16,817 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=c9d13a2e32b182765840f6e1f06b1b0f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:14:16,817 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1689185656195.c9d13a2e32b182765840f6e1f06b1b0f.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689185656816"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689185656816"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689185656816"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689185656816"}]},"ts":"1689185656816"} 2023-07-12 18:14:16,826 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-12 18:14:16,826 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure c9d13a2e32b182765840f6e1f06b1b0f, server=jenkins-hbase4.apache.org,34493,1689185653159 in 207 msec 2023-07-12 18:14:16,829 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-12 18:14:16,830 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=c9d13a2e32b182765840f6e1f06b1b0f, ASSIGN in 379 msec 2023-07-12 18:14:16,832 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 18:14:16,832 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689185656832"}]},"ts":"1689185656832"} 2023-07-12 18:14:16,836 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-12 18:14:16,839 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 18:14:16,842 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 642 msec 2023-07-12 18:14:16,909 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-12 18:14:16,913 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-12 18:14:16,913 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 18:14:16,953 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-12 18:14:16,971 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-12 18:14:16,980 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 36 msec 2023-07-12 18:14:16,987 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-12 18:14:17,000 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-12 18:14:17,006 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 19 msec 2023-07-12 18:14:17,014 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-12 18:14:17,018 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-12 18:14:17,019 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.776sec 2023-07-12 18:14:17,023 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-12 18:14:17,025 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-12 18:14:17,025 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-12 18:14:17,026 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43177,1689185651541-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-12 18:14:17,027 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43177,1689185651541-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-12 18:14:17,051 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-12 18:14:17,054 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-07-12 18:14:17,057 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 18:14:17,060 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 18:14:17,064 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/hbase/acl/f85a69b35af74d348ccb66c05819106e 2023-07-12 18:14:17,064 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-07-12 18:14:17,065 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/hbase/acl/f85a69b35af74d348ccb66c05819106e empty. 2023-07-12 18:14:17,068 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/hbase/acl/f85a69b35af74d348ccb66c05819106e 2023-07-12 18:14:17,068 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-07-12 18:14:17,074 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-12 18:14:17,106 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-07-12 18:14:17,108 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => f85a69b35af74d348ccb66c05819106e, NAME => 'hbase:acl,,1689185657046.f85a69b35af74d348ccb66c05819106e.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp 2023-07-12 18:14:17,122 DEBUG [Listener at localhost/42431] zookeeper.ReadOnlyZKClient(139): Connect 0x79a32b3f to 127.0.0.1:62122 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 18:14:17,141 DEBUG [Listener at localhost/42431] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@51e09f23, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 18:14:17,142 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689185657046.f85a69b35af74d348ccb66c05819106e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 18:14:17,142 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing f85a69b35af74d348ccb66c05819106e, disabling compactions & flushes 2023-07-12 18:14:17,143 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689185657046.f85a69b35af74d348ccb66c05819106e. 2023-07-12 18:14:17,143 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689185657046.f85a69b35af74d348ccb66c05819106e. 2023-07-12 18:14:17,143 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689185657046.f85a69b35af74d348ccb66c05819106e. after waiting 0 ms 2023-07-12 18:14:17,143 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689185657046.f85a69b35af74d348ccb66c05819106e. 2023-07-12 18:14:17,143 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1689185657046.f85a69b35af74d348ccb66c05819106e. 2023-07-12 18:14:17,143 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for f85a69b35af74d348ccb66c05819106e: 2023-07-12 18:14:17,150 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 18:14:17,152 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1689185657046.f85a69b35af74d348ccb66c05819106e.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689185657152"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689185657152"}]},"ts":"1689185657152"} 2023-07-12 18:14:17,155 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-12 18:14:17,158 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 18:14:17,159 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689185657158"}]},"ts":"1689185657158"} 2023-07-12 18:14:17,161 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-07-12 18:14:17,162 DEBUG [hconnection-0x211949ec-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 18:14:17,166 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-12 18:14:17,168 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 18:14:17,168 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 18:14:17,168 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-12 18:14:17,168 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 18:14:17,168 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=f85a69b35af74d348ccb66c05819106e, ASSIGN}] 2023-07-12 18:14:17,173 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=f85a69b35af74d348ccb66c05819106e, ASSIGN 2023-07-12 18:14:17,175 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=f85a69b35af74d348ccb66c05819106e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34493,1689185653159; forceNewPlan=false, retain=false 2023-07-12 18:14:17,178 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-12 18:14:17,182 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60284, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 18:14:17,185 INFO [Listener at localhost/42431] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,43177,1689185651541 2023-07-12 18:14:17,185 INFO [Listener at localhost/42431] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-07-12 18:14:17,185 INFO [Listener at localhost/42431] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/908563f7-ecc5-f8cf-2e08-f8e1a8353ad0/test.cache.data in system properties and HBase conf 2023-07-12 18:14:17,185 INFO [Listener at localhost/42431] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/908563f7-ecc5-f8cf-2e08-f8e1a8353ad0/hadoop.tmp.dir in system properties and HBase conf 2023-07-12 18:14:17,185 INFO [Listener at localhost/42431] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/908563f7-ecc5-f8cf-2e08-f8e1a8353ad0/hadoop.log.dir in system properties and HBase conf 2023-07-12 18:14:17,185 INFO [Listener at localhost/42431] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/908563f7-ecc5-f8cf-2e08-f8e1a8353ad0/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-12 18:14:17,186 INFO [Listener at localhost/42431] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/908563f7-ecc5-f8cf-2e08-f8e1a8353ad0/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-12 18:14:17,186 INFO [Listener at localhost/42431] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-12 18:14:17,186 INFO [Listener at localhost/42431] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/908563f7-ecc5-f8cf-2e08-f8e1a8353ad0/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-12 18:14:17,186 INFO [Listener at localhost/42431] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/908563f7-ecc5-f8cf-2e08-f8e1a8353ad0/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-12 18:14:17,186 INFO [Listener at localhost/42431] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/908563f7-ecc5-f8cf-2e08-f8e1a8353ad0/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-12 18:14:17,186 INFO [Listener at localhost/42431] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/908563f7-ecc5-f8cf-2e08-f8e1a8353ad0/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-12 18:14:17,186 INFO [Listener at localhost/42431] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/908563f7-ecc5-f8cf-2e08-f8e1a8353ad0/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-12 18:14:17,187 INFO [Listener at localhost/42431] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/908563f7-ecc5-f8cf-2e08-f8e1a8353ad0/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-12 18:14:17,187 INFO [Listener at localhost/42431] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/908563f7-ecc5-f8cf-2e08-f8e1a8353ad0/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-12 18:14:17,187 INFO [Listener at localhost/42431] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/908563f7-ecc5-f8cf-2e08-f8e1a8353ad0/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-12 18:14:17,187 INFO [Listener at localhost/42431] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/908563f7-ecc5-f8cf-2e08-f8e1a8353ad0/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-12 18:14:17,187 INFO [Listener at localhost/42431] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/908563f7-ecc5-f8cf-2e08-f8e1a8353ad0/nfs.dump.dir in system properties and HBase conf 2023-07-12 18:14:17,187 INFO [Listener at localhost/42431] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/908563f7-ecc5-f8cf-2e08-f8e1a8353ad0/java.io.tmpdir in system properties and HBase conf 2023-07-12 18:14:17,187 INFO [Listener at localhost/42431] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/908563f7-ecc5-f8cf-2e08-f8e1a8353ad0/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-12 18:14:17,187 INFO [Listener at localhost/42431] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/908563f7-ecc5-f8cf-2e08-f8e1a8353ad0/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-12 18:14:17,188 INFO [Listener at localhost/42431] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/908563f7-ecc5-f8cf-2e08-f8e1a8353ad0/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-07-12 18:14:17,325 INFO [jenkins-hbase4:43177] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-12 18:14:17,326 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=f85a69b35af74d348ccb66c05819106e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:14:17,327 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1689185657046.f85a69b35af74d348ccb66c05819106e.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689185657326"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689185657326"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689185657326"}]},"ts":"1689185657326"} 2023-07-12 18:14:17,330 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure f85a69b35af74d348ccb66c05819106e, server=jenkins-hbase4.apache.org,34493,1689185653159}] 2023-07-12 18:14:17,378 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-12 18:14:17,513 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1689185657046.f85a69b35af74d348ccb66c05819106e. 2023-07-12 18:14:17,513 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f85a69b35af74d348ccb66c05819106e, NAME => 'hbase:acl,,1689185657046.f85a69b35af74d348ccb66c05819106e.', STARTKEY => '', ENDKEY => ''} 2023-07-12 18:14:17,514 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1689185657046.f85a69b35af74d348ccb66c05819106e. service=AccessControlService 2023-07-12 18:14:17,514 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 18:14:17,514 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl f85a69b35af74d348ccb66c05819106e 2023-07-12 18:14:17,514 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689185657046.f85a69b35af74d348ccb66c05819106e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 18:14:17,514 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f85a69b35af74d348ccb66c05819106e 2023-07-12 18:14:17,514 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f85a69b35af74d348ccb66c05819106e 2023-07-12 18:14:17,517 INFO [StoreOpener-f85a69b35af74d348ccb66c05819106e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region f85a69b35af74d348ccb66c05819106e 2023-07-12 18:14:17,524 DEBUG [StoreOpener-f85a69b35af74d348ccb66c05819106e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/hbase/acl/f85a69b35af74d348ccb66c05819106e/l 2023-07-12 18:14:17,525 DEBUG [StoreOpener-f85a69b35af74d348ccb66c05819106e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/hbase/acl/f85a69b35af74d348ccb66c05819106e/l 2023-07-12 18:14:17,525 INFO [StoreOpener-f85a69b35af74d348ccb66c05819106e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f85a69b35af74d348ccb66c05819106e columnFamilyName l 2023-07-12 18:14:17,526 INFO [StoreOpener-f85a69b35af74d348ccb66c05819106e-1] regionserver.HStore(310): Store=f85a69b35af74d348ccb66c05819106e/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 18:14:17,531 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/hbase/acl/f85a69b35af74d348ccb66c05819106e 2023-07-12 18:14:17,532 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/hbase/acl/f85a69b35af74d348ccb66c05819106e 2023-07-12 18:14:17,538 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f85a69b35af74d348ccb66c05819106e 2023-07-12 18:14:17,544 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/hbase/acl/f85a69b35af74d348ccb66c05819106e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 18:14:17,545 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f85a69b35af74d348ccb66c05819106e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70948089, jitterRate=0.05720891058444977}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 18:14:17,546 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f85a69b35af74d348ccb66c05819106e: 2023-07-12 18:14:17,547 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1689185657046.f85a69b35af74d348ccb66c05819106e., pid=11, masterSystemTime=1689185657497 2023-07-12 18:14:17,550 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1689185657046.f85a69b35af74d348ccb66c05819106e. 2023-07-12 18:14:17,550 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1689185657046.f85a69b35af74d348ccb66c05819106e. 2023-07-12 18:14:17,551 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=f85a69b35af74d348ccb66c05819106e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:14:17,552 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1689185657046.f85a69b35af74d348ccb66c05819106e.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689185657551"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689185657551"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689185657551"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689185657551"}]},"ts":"1689185657551"} 2023-07-12 18:14:17,559 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-07-12 18:14:17,559 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure f85a69b35af74d348ccb66c05819106e, server=jenkins-hbase4.apache.org,34493,1689185653159 in 225 msec 2023-07-12 18:14:17,564 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-07-12 18:14:17,564 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=f85a69b35af74d348ccb66c05819106e, ASSIGN in 391 msec 2023-07-12 18:14:17,566 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 18:14:17,566 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689185657566"}]},"ts":"1689185657566"} 2023-07-12 18:14:17,569 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-07-12 18:14:17,575 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 18:14:17,580 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 524 msec 2023-07-12 18:14:17,678 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-12 18:14:17,679 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-07-12 18:14:17,690 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-12 18:14:18,634 WARN [Thread-382] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 18:14:19,049 INFO [Thread-382] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 18:14:19,056 INFO [Thread-382] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/908563f7-ecc5-f8cf-2e08-f8e1a8353ad0/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_44917_jobhistory____.6v43c/webapp 2023-07-12 18:14:19,271 INFO [Thread-382] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-07-12 18:14:19,272 INFO [Thread-382] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-07-12 18:14:19,272 INFO [Thread-382] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-12 18:14:19,277 INFO [Thread-382] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-12 18:14:19,377 INFO [Thread-382] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-12 18:14:19,781 INFO [Thread-382] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-12 18:14:20,297 INFO [Thread-382] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-07-12 18:14:20,403 INFO [Thread-382] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:44917 2023-07-12 18:14:21,442 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-12 18:14:21,768 WARN [Listener at jenkins-hbase4.apache.org/33397] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 18:14:21,777 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-12 18:14:21,778 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-12 18:14:21,779 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-07-12 18:14:21,780 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 18:14:21,780 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-07-12 18:14:21,781 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 18:14:21,781 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-07-12 18:14:21,781 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-12 18:14:21,781 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-07-12 18:14:21,781 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 18:14:21,781 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-07-12 18:14:21,782 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-12 18:14:21,782 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-12 18:14:21,865 WARN [Listener at jenkins-hbase4.apache.org/33397] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-12 18:14:21,866 INFO [Listener at jenkins-hbase4.apache.org/33397] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 18:14:21,876 INFO [Listener at jenkins-hbase4.apache.org/33397] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/908563f7-ecc5-f8cf-2e08-f8e1a8353ad0/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_44153_cluster____.uodoej/webapp 2023-07-12 18:14:21,952 INFO [Listener at jenkins-hbase4.apache.org/33397] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-07-12 18:14:21,953 INFO [Listener at jenkins-hbase4.apache.org/33397] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-07-12 18:14:21,953 INFO [Listener at jenkins-hbase4.apache.org/33397] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-12 18:14:21,953 INFO [Listener at jenkins-hbase4.apache.org/33397] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-12 18:14:21,965 INFO [Listener at jenkins-hbase4.apache.org/33397] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-12 18:14:22,172 INFO [Listener at jenkins-hbase4.apache.org/33397] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-12 18:14:22,346 INFO [Listener at jenkins-hbase4.apache.org/33397] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-12 18:14:22,359 INFO [Listener at jenkins-hbase4.apache.org/33397] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:44153 2023-07-12 18:14:22,860 WARN [Listener at jenkins-hbase4.apache.org/34637] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 18:14:22,901 WARN [Listener at jenkins-hbase4.apache.org/34637] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-12 18:14:22,902 INFO [Listener at jenkins-hbase4.apache.org/34637] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 18:14:22,910 INFO [Listener at jenkins-hbase4.apache.org/34637] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/908563f7-ecc5-f8cf-2e08-f8e1a8353ad0/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_35499_node____djwfk/webapp 2023-07-12 18:14:22,968 INFO [Listener at jenkins-hbase4.apache.org/34637] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-12 18:14:22,968 INFO [Listener at jenkins-hbase4.apache.org/34637] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-12 18:14:22,969 INFO [Listener at jenkins-hbase4.apache.org/34637] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-12 18:14:22,969 INFO [Listener at jenkins-hbase4.apache.org/34637] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-12 18:14:22,980 INFO [Listener at jenkins-hbase4.apache.org/34637] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-12 18:14:23,010 INFO [Listener at jenkins-hbase4.apache.org/34637] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-12 18:14:23,144 INFO [Listener at jenkins-hbase4.apache.org/34637] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-12 18:14:23,179 INFO [Listener at jenkins-hbase4.apache.org/34637] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:35499 2023-07-12 18:14:23,433 WARN [Listener at jenkins-hbase4.apache.org/41393] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 18:14:23,443 WARN [Listener at jenkins-hbase4.apache.org/41393] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-12 18:14:23,444 INFO [Listener at jenkins-hbase4.apache.org/41393] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 18:14:23,456 INFO [Listener at jenkins-hbase4.apache.org/41393] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/908563f7-ecc5-f8cf-2e08-f8e1a8353ad0/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_35279_node____.4puevk/webapp 2023-07-12 18:14:23,541 INFO [Listener at jenkins-hbase4.apache.org/41393] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-12 18:14:23,542 INFO [Listener at jenkins-hbase4.apache.org/41393] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-12 18:14:23,542 INFO [Listener at jenkins-hbase4.apache.org/41393] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-12 18:14:23,542 INFO [Listener at jenkins-hbase4.apache.org/41393] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-12 18:14:23,560 INFO [Listener at jenkins-hbase4.apache.org/41393] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-12 18:14:23,583 INFO [Listener at jenkins-hbase4.apache.org/41393] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-12 18:14:23,707 INFO [Listener at jenkins-hbase4.apache.org/41393] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-12 18:14:23,719 INFO [Listener at jenkins-hbase4.apache.org/41393] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:35279 2023-07-12 18:14:23,764 INFO [Listener at jenkins-hbase4.apache.org/41393] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-07-12 18:14:23,766 INFO [Listener at jenkins-hbase4.apache.org/41393] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 18:14:23,831 INFO [Listener at jenkins-hbase4.apache.org/41393] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=702, OpenFileDescriptor=889, MaxFileDescriptor=60000, SystemLoadAverage=284, ProcessCount=173, AvailableMemoryMB=6923 2023-07-12 18:14:23,831 WARN [Listener at jenkins-hbase4.apache.org/41393] hbase.ResourceChecker(130): Thread=702 is superior to 500 2023-07-12 18:14:23,847 DEBUG [Listener at jenkins-hbase4.apache.org/41393] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-12 18:14:23,852 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43790, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-12 18:14:23,860 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-12 18:14:23,863 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-07-12 18:14:23,866 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 18:14:23,867 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-07-12 18:14:23,870 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-12 18:14:23,871 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 18:14:23,876 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testExportWithTargetName/3cc09c852c1c1ab92f2fdae31f4311f2 2023-07-12 18:14:23,876 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testExportWithTargetName/a1bf139ce3f353f6bf68cb2527c654d6 2023-07-12 18:14:23,877 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testExportWithTargetName/3cc09c852c1c1ab92f2fdae31f4311f2 empty. 2023-07-12 18:14:23,877 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testExportWithTargetName/a1bf139ce3f353f6bf68cb2527c654d6 empty. 2023-07-12 18:14:23,879 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testExportWithTargetName/3cc09c852c1c1ab92f2fdae31f4311f2 2023-07-12 18:14:23,879 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testExportWithTargetName/a1bf139ce3f353f6bf68cb2527c654d6 2023-07-12 18:14:23,880 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-12 18:14:23,913 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-07-12 18:14:23,915 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => a1bf139ce3f353f6bf68cb2527c654d6, NAME => 'testtb-testExportWithTargetName,1,1689185663860.a1bf139ce3f353f6bf68cb2527c654d6.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp 2023-07-12 18:14:23,915 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => 3cc09c852c1c1ab92f2fdae31f4311f2, NAME => 'testtb-testExportWithTargetName,,1689185663860.3cc09c852c1c1ab92f2fdae31f4311f2.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp 2023-07-12 18:14:23,966 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689185663860.a1bf139ce3f353f6bf68cb2527c654d6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 18:14:23,966 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689185663860.3cc09c852c1c1ab92f2fdae31f4311f2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 18:14:23,972 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing a1bf139ce3f353f6bf68cb2527c654d6, disabling compactions & flushes 2023-07-12 18:14:23,972 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing 3cc09c852c1c1ab92f2fdae31f4311f2, disabling compactions & flushes 2023-07-12 18:14:23,972 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689185663860.a1bf139ce3f353f6bf68cb2527c654d6. 2023-07-12 18:14:23,972 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689185663860.3cc09c852c1c1ab92f2fdae31f4311f2. 2023-07-12 18:14:23,972 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689185663860.a1bf139ce3f353f6bf68cb2527c654d6. 2023-07-12 18:14:23,972 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689185663860.3cc09c852c1c1ab92f2fdae31f4311f2. 2023-07-12 18:14:23,972 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689185663860.a1bf139ce3f353f6bf68cb2527c654d6. after waiting 0 ms 2023-07-12 18:14:23,972 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689185663860.3cc09c852c1c1ab92f2fdae31f4311f2. after waiting 0 ms 2023-07-12 18:14:23,972 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689185663860.a1bf139ce3f353f6bf68cb2527c654d6. 2023-07-12 18:14:23,972 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689185663860.3cc09c852c1c1ab92f2fdae31f4311f2. 2023-07-12 18:14:23,972 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689185663860.a1bf139ce3f353f6bf68cb2527c654d6. 2023-07-12 18:14:23,972 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689185663860.3cc09c852c1c1ab92f2fdae31f4311f2. 2023-07-12 18:14:23,972 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for a1bf139ce3f353f6bf68cb2527c654d6: 2023-07-12 18:14:23,972 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for 3cc09c852c1c1ab92f2fdae31f4311f2: 2023-07-12 18:14:23,973 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-12 18:14:23,977 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 18:14:23,979 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689185663860.a1bf139ce3f353f6bf68cb2527c654d6.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689185663979"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689185663979"}]},"ts":"1689185663979"} 2023-07-12 18:14:23,979 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689185663860.3cc09c852c1c1ab92f2fdae31f4311f2.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689185663979"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689185663979"}]},"ts":"1689185663979"} 2023-07-12 18:14:24,030 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-12 18:14:24,032 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 18:14:24,032 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689185664032"}]},"ts":"1689185664032"} 2023-07-12 18:14:24,035 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-07-12 18:14:24,040 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-12 18:14:24,042 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 18:14:24,042 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 18:14:24,042 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-12 18:14:24,042 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 18:14:24,043 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=3cc09c852c1c1ab92f2fdae31f4311f2, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=a1bf139ce3f353f6bf68cb2527c654d6, ASSIGN}] 2023-07-12 18:14:24,046 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=a1bf139ce3f353f6bf68cb2527c654d6, ASSIGN 2023-07-12 18:14:24,046 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=3cc09c852c1c1ab92f2fdae31f4311f2, ASSIGN 2023-07-12 18:14:24,049 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=a1bf139ce3f353f6bf68cb2527c654d6, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37689,1689185653014; forceNewPlan=false, retain=false 2023-07-12 18:14:24,049 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=3cc09c852c1c1ab92f2fdae31f4311f2, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34205,1689185653087; forceNewPlan=false, retain=false 2023-07-12 18:14:24,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-12 18:14:24,199 INFO [jenkins-hbase4:43177] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-12 18:14:24,202 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=3cc09c852c1c1ab92f2fdae31f4311f2, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:14:24,202 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=a1bf139ce3f353f6bf68cb2527c654d6, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:14:24,202 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689185663860.3cc09c852c1c1ab92f2fdae31f4311f2.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689185664202"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689185664202"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689185664202"}]},"ts":"1689185664202"} 2023-07-12 18:14:24,202 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689185663860.a1bf139ce3f353f6bf68cb2527c654d6.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689185664202"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689185664202"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689185664202"}]},"ts":"1689185664202"} 2023-07-12 18:14:24,208 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE; OpenRegionProcedure a1bf139ce3f353f6bf68cb2527c654d6, server=jenkins-hbase4.apache.org,37689,1689185653014}] 2023-07-12 18:14:24,213 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=13, state=RUNNABLE; OpenRegionProcedure 3cc09c852c1c1ab92f2fdae31f4311f2, server=jenkins-hbase4.apache.org,34205,1689185653087}] 2023-07-12 18:14:24,364 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:14:24,365 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-12 18:14:24,370 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44418, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-12 18:14:24,376 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1689185663860.a1bf139ce3f353f6bf68cb2527c654d6. 2023-07-12 18:14:24,377 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a1bf139ce3f353f6bf68cb2527c654d6, NAME => 'testtb-testExportWithTargetName,1,1689185663860.a1bf139ce3f353f6bf68cb2527c654d6.', STARTKEY => '1', ENDKEY => ''} 2023-07-12 18:14:24,377 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1689185663860.a1bf139ce3f353f6bf68cb2527c654d6. service=AccessControlService 2023-07-12 18:14:24,377 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 18:14:24,377 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName a1bf139ce3f353f6bf68cb2527c654d6 2023-07-12 18:14:24,377 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689185663860.a1bf139ce3f353f6bf68cb2527c654d6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 18:14:24,377 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for a1bf139ce3f353f6bf68cb2527c654d6 2023-07-12 18:14:24,378 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for a1bf139ce3f353f6bf68cb2527c654d6 2023-07-12 18:14:24,381 INFO [StoreOpener-a1bf139ce3f353f6bf68cb2527c654d6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region a1bf139ce3f353f6bf68cb2527c654d6 2023-07-12 18:14:24,383 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:14:24,383 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-12 18:14:24,387 DEBUG [StoreOpener-a1bf139ce3f353f6bf68cb2527c654d6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testExportWithTargetName/a1bf139ce3f353f6bf68cb2527c654d6/cf 2023-07-12 18:14:24,388 DEBUG [StoreOpener-a1bf139ce3f353f6bf68cb2527c654d6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testExportWithTargetName/a1bf139ce3f353f6bf68cb2527c654d6/cf 2023-07-12 18:14:24,389 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38756, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-12 18:14:24,393 INFO [StoreOpener-a1bf139ce3f353f6bf68cb2527c654d6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a1bf139ce3f353f6bf68cb2527c654d6 columnFamilyName cf 2023-07-12 18:14:24,395 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1689185663860.3cc09c852c1c1ab92f2fdae31f4311f2. 2023-07-12 18:14:24,395 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 3cc09c852c1c1ab92f2fdae31f4311f2, NAME => 'testtb-testExportWithTargetName,,1689185663860.3cc09c852c1c1ab92f2fdae31f4311f2.', STARTKEY => '', ENDKEY => '1'} 2023-07-12 18:14:24,395 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1689185663860.3cc09c852c1c1ab92f2fdae31f4311f2. service=AccessControlService 2023-07-12 18:14:24,396 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 18:14:24,396 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 3cc09c852c1c1ab92f2fdae31f4311f2 2023-07-12 18:14:24,396 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689185663860.3cc09c852c1c1ab92f2fdae31f4311f2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 18:14:24,396 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 3cc09c852c1c1ab92f2fdae31f4311f2 2023-07-12 18:14:24,396 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 3cc09c852c1c1ab92f2fdae31f4311f2 2023-07-12 18:14:24,396 INFO [StoreOpener-a1bf139ce3f353f6bf68cb2527c654d6-1] regionserver.HStore(310): Store=a1bf139ce3f353f6bf68cb2527c654d6/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 18:14:24,400 INFO [StoreOpener-3cc09c852c1c1ab92f2fdae31f4311f2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 3cc09c852c1c1ab92f2fdae31f4311f2 2023-07-12 18:14:24,401 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testExportWithTargetName/a1bf139ce3f353f6bf68cb2527c654d6 2023-07-12 18:14:24,402 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testExportWithTargetName/a1bf139ce3f353f6bf68cb2527c654d6 2023-07-12 18:14:24,402 DEBUG [StoreOpener-3cc09c852c1c1ab92f2fdae31f4311f2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testExportWithTargetName/3cc09c852c1c1ab92f2fdae31f4311f2/cf 2023-07-12 18:14:24,403 DEBUG [StoreOpener-3cc09c852c1c1ab92f2fdae31f4311f2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testExportWithTargetName/3cc09c852c1c1ab92f2fdae31f4311f2/cf 2023-07-12 18:14:24,403 INFO [StoreOpener-3cc09c852c1c1ab92f2fdae31f4311f2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3cc09c852c1c1ab92f2fdae31f4311f2 columnFamilyName cf 2023-07-12 18:14:24,404 INFO [StoreOpener-3cc09c852c1c1ab92f2fdae31f4311f2-1] regionserver.HStore(310): Store=3cc09c852c1c1ab92f2fdae31f4311f2/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 18:14:24,406 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testExportWithTargetName/3cc09c852c1c1ab92f2fdae31f4311f2 2023-07-12 18:14:24,411 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for a1bf139ce3f353f6bf68cb2527c654d6 2023-07-12 18:14:24,413 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testExportWithTargetName/3cc09c852c1c1ab92f2fdae31f4311f2 2023-07-12 18:14:24,427 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testExportWithTargetName/a1bf139ce3f353f6bf68cb2527c654d6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 18:14:24,428 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened a1bf139ce3f353f6bf68cb2527c654d6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62281453, jitterRate=-0.07193402945995331}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 18:14:24,428 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for a1bf139ce3f353f6bf68cb2527c654d6: 2023-07-12 18:14:24,430 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1689185663860.a1bf139ce3f353f6bf68cb2527c654d6., pid=15, masterSystemTime=1689185664364 2023-07-12 18:14:24,439 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1689185663860.a1bf139ce3f353f6bf68cb2527c654d6. 2023-07-12 18:14:24,440 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1689185663860.a1bf139ce3f353f6bf68cb2527c654d6. 2023-07-12 18:14:24,442 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=a1bf139ce3f353f6bf68cb2527c654d6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:14:24,442 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1689185663860.a1bf139ce3f353f6bf68cb2527c654d6.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689185664441"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689185664441"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689185664441"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689185664441"}]},"ts":"1689185664441"} 2023-07-12 18:14:24,443 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 3cc09c852c1c1ab92f2fdae31f4311f2 2023-07-12 18:14:24,448 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=14 2023-07-12 18:14:24,450 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=14, state=SUCCESS; OpenRegionProcedure a1bf139ce3f353f6bf68cb2527c654d6, server=jenkins-hbase4.apache.org,37689,1689185653014 in 237 msec 2023-07-12 18:14:24,452 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testExportWithTargetName/3cc09c852c1c1ab92f2fdae31f4311f2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 18:14:24,453 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 3cc09c852c1c1ab92f2fdae31f4311f2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63864522, jitterRate=-0.04834446310997009}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 18:14:24,453 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 3cc09c852c1c1ab92f2fdae31f4311f2: 2023-07-12 18:14:24,453 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=a1bf139ce3f353f6bf68cb2527c654d6, ASSIGN in 407 msec 2023-07-12 18:14:24,454 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1689185663860.3cc09c852c1c1ab92f2fdae31f4311f2., pid=16, masterSystemTime=1689185664383 2023-07-12 18:14:24,459 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1689185663860.3cc09c852c1c1ab92f2fdae31f4311f2. 2023-07-12 18:14:24,459 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1689185663860.3cc09c852c1c1ab92f2fdae31f4311f2. 2023-07-12 18:14:24,460 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=3cc09c852c1c1ab92f2fdae31f4311f2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:14:24,460 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1689185663860.3cc09c852c1c1ab92f2fdae31f4311f2.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689185664460"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689185664460"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689185664460"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689185664460"}]},"ts":"1689185664460"} 2023-07-12 18:14:24,465 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=13 2023-07-12 18:14:24,465 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=13, state=SUCCESS; OpenRegionProcedure 3cc09c852c1c1ab92f2fdae31f4311f2, server=jenkins-hbase4.apache.org,34205,1689185653087 in 250 msec 2023-07-12 18:14:24,469 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=13, resume processing ppid=12 2023-07-12 18:14:24,469 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=3cc09c852c1c1ab92f2fdae31f4311f2, ASSIGN in 422 msec 2023-07-12 18:14:24,470 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 18:14:24,471 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689185664470"}]},"ts":"1689185664470"} 2023-07-12 18:14:24,473 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-07-12 18:14:24,476 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 18:14:24,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-12 18:14:24,482 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-07-12 18:14:24,504 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34493] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-12 18:14:24,543 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-12 18:14:24,543 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-12 18:14:24,543 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-12 18:14:24,543 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-12 18:14:24,543 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 18:14:24,551 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-12 18:14:24,551 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-12 18:14:24,551 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-12 18:14:24,551 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-12 18:14:24,552 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-12 18:14:24,552 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-12 18:14:24,552 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-12 18:14:24,553 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-12 18:14:24,554 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 691 msec 2023-07-12 18:14:24,978 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-12 18:14:24,978 INFO [Listener at jenkins-hbase4.apache.org/41393] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-07-12 18:14:24,982 DEBUG [Listener at jenkins-hbase4.apache.org/41393] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-12 18:14:24,984 DEBUG [Listener at jenkins-hbase4.apache.org/41393] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1689185663860.3cc09c852c1c1ab92f2fdae31f4311f2. 2023-07-12 18:14:24,986 INFO [Listener at jenkins-hbase4.apache.org/41393] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 18:14:25,012 DEBUG [hconnection-0x211949ec-shared-pool-4] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 18:14:25,018 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38758, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 18:14:25,023 DEBUG [hconnection-0x211949ec-shared-pool-5] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 18:14:25,029 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44430, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 18:14:25,052 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-12 18:14:25,052 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689185665052 (current time:1689185665052). 2023-07-12 18:14:25,052 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 18:14:25,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] zookeeper.ReadOnlyZKClient(139): Connect 0x6aa9c961 to 127.0.0.1:62122 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 18:14:25,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1ab7634f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 18:14:25,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 18:14:25,067 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53094, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 18:14:25,068 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6aa9c961 to 127.0.0.1:62122 2023-07-12 18:14:25,069 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 18:14:25,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] zookeeper.ReadOnlyZKClient(139): Connect 0x4b30da28 to 127.0.0.1:62122 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 18:14:25,083 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@84db0d0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 18:14:25,087 DEBUG [hconnection-0x14f16a76-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 18:14:25,090 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53102, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 18:14:25,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4b30da28 to 127.0.0.1:62122 2023-07-12 18:14:25,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 18:14:25,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-12 18:14:25,128 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 18:14:25,130 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-12 18:14:25,151 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] procedure2.ProcedureExecutor(1029): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-12 18:14:25,153 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-12 18:14:25,155 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689186265155 2023-07-12 18:14:25,155 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-12 18:14:25,155 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-12 18:14:25,158 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-12 18:14:25,162 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-12 18:14:25,162 DEBUG [Listener at jenkins-hbase4.apache.org/41393] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 18:14:25,162 DEBUG [Listener at jenkins-hbase4.apache.org/41393] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 18:14:25,163 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 15 msec 2023-07-12 18:14:25,164 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-12 18:14:25,164 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689186265164 2023-07-12 18:14:25,190 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,192 INFO [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-07-12 18:14:25,192 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 18:14:25,194 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-07-12 18:14:25,194 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-12 18:14:25,194 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,194 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,200 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:14:25,200 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:14:25,200 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:14:25,200 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:14:25,200 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:14:25,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:14:25,200 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:14:25,200 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:14:25,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:14:25,200 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:14:25,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:14:25,201 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:14:25,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,201 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:14:25,201 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,201 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 18:14:25,201 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-12 18:14:25,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,202 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-12 18:14:25,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,202 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-12 18:14:25,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-12 18:14:25,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,202 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-12 18:14:25,204 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-12 18:14:25,206 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,210 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,210 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,211 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-12 18:14:25,211 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-12 18:14:25,211 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 18:14:25,211 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 18:14:25,211 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-12 18:14:25,211 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 18:14:25,214 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-12 18:14:25,214 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-12 18:14:25,214 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-12 18:14:25,214 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37689,1689185653014' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-12 18:14:25,214 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-12 18:14:25,214 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-12 18:14:25,214 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34493,1689185653159' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-12 18:14:25,214 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-12 18:14:25,215 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34205,1689185653087' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-12 18:14:25,218 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:14:25,218 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:14:25,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 18:14:25,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 18:14:25,219 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,224 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 18:14:25,224 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:14:25,224 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,225 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 18:14:25,225 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,225 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 18:14:25,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 18:14:25,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:14:25,226 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,226 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 18:14:25,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:14:25,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:14:25,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 18:14:25,227 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37689,1689185653014' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-12 18:14:25,227 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5d7e5e24[Count = 1] remaining members to acquire global barrier 2023-07-12 18:14:25,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:14:25,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 18:14:25,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 18:14:25,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 18:14:25,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 18:14:25,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:14:25,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:14:25,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:14:25,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 18:14:25,230 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34205,1689185653087' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-12 18:14:25,231 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5d7e5e24[Count = 0] remaining members to acquire global barrier 2023-07-12 18:14:25,231 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-12 18:14:25,231 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,234 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,234 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,234 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,234 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,234 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,234 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-12 18:14:25,234 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-12 18:14:25,234 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-12 18:14:25,234 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,34493,1689185653159' in zk 2023-07-12 18:14:25,234 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:14:25,236 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:14:25,236 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 18:14:25,238 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,244 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-12 18:14:25,244 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 18:14:25,244 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 18:14:25,244 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 18:14:25,244 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 18:14:25,244 DEBUG [rs(jenkins-hbase4.apache.org,34205,1689185653087)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689185663860.3cc09c852c1c1ab92f2fdae31f4311f2. 2023-07-12 18:14:25,244 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-12 18:14:25,244 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 18:14:25,245 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-12 18:14:25,246 DEBUG [rs(jenkins-hbase4.apache.org,37689,1689185653014)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689185663860.a1bf139ce3f353f6bf68cb2527c654d6. 2023-07-12 18:14:25,246 DEBUG [rs(jenkins-hbase4.apache.org,34205,1689185653087)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689185663860.3cc09c852c1c1ab92f2fdae31f4311f2. started... 2023-07-12 18:14:25,246 DEBUG [rs(jenkins-hbase4.apache.org,37689,1689185653014)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689185663860.a1bf139ce3f353f6bf68cb2527c654d6. started... 2023-07-12 18:14:25,249 DEBUG [rs(jenkins-hbase4.apache.org,34205,1689185653087)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 3cc09c852c1c1ab92f2fdae31f4311f2: 2023-07-12 18:14:25,249 DEBUG [rs(jenkins-hbase4.apache.org,37689,1689185653014)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a1bf139ce3f353f6bf68cb2527c654d6: 2023-07-12 18:14:25,250 DEBUG [rs(jenkins-hbase4.apache.org,34205,1689185653087)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689185663860.3cc09c852c1c1ab92f2fdae31f4311f2.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,250 DEBUG [rs(jenkins-hbase4.apache.org,37689,1689185653014)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689185663860.a1bf139ce3f353f6bf68cb2527c654d6.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,255 DEBUG [rs(jenkins-hbase4.apache.org,34205,1689185653087)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 18:14:25,255 DEBUG [rs(jenkins-hbase4.apache.org,37689,1689185653014)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 18:14:25,259 DEBUG [rs(jenkins-hbase4.apache.org,34205,1689185653087)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 18:14:25,259 DEBUG [rs(jenkins-hbase4.apache.org,37689,1689185653014)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 18:14:25,263 DEBUG [Listener at jenkins-hbase4.apache.org/41393] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 18:14:25,278 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-12 18:14:25,293 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-12 18:14:25,293 DEBUG [Listener at jenkins-hbase4.apache.org/41393] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 18:14:25,307 DEBUG [rs(jenkins-hbase4.apache.org,37689,1689185653014)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689185663860.a1bf139ce3f353f6bf68cb2527c654d6. completed. 2023-07-12 18:14:25,307 DEBUG [rs(jenkins-hbase4.apache.org,37689,1689185653014)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689185663860.a1bf139ce3f353f6bf68cb2527c654d6. 2023-07-12 18:14:25,308 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 18:14:25,309 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 18:14:25,309 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:14:25,310 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-12 18:14:25,310 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,37689,1689185653014' in zk 2023-07-12 18:14:25,314 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-12 18:14:25,314 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 18:14:25,314 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-12 18:14:25,315 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:14:25,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:14:25,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 18:14:25,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 18:14:25,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 18:14:25,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 18:14:25,318 DEBUG [rs(jenkins-hbase4.apache.org,34205,1689185653087)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689185663860.3cc09c852c1c1ab92f2fdae31f4311f2. completed. 2023-07-12 18:14:25,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,318 DEBUG [rs(jenkins-hbase4.apache.org,34205,1689185653087)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689185663860.3cc09c852c1c1ab92f2fdae31f4311f2. 2023-07-12 18:14:25,318 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 18:14:25,318 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 18:14:25,318 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:14:25,318 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-12 18:14:25,318 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,34205,1689185653087' in zk 2023-07-12 18:14:25,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:14:25,320 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:14:25,320 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-12 18:14:25,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:14:25,320 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 18:14:25,321 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-12 18:14:25,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:14:25,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 18:14:25,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:14:25,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:14:25,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:14:25,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,37689,1689185653014': 2023-07-12 18:14:25,327 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37689,1689185653014' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-12 18:14:25,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:14:25,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 18:14:25,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 18:14:25,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 18:14:25,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 18:14:25,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:14:25,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:14:25,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:14:25,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 18:14:25,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:14:25,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:14:25,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:14:25,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,34205,1689185653087': 2023-07-12 18:14:25,334 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34205,1689185653087' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-12 18:14:25,334 INFO [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-07-12 18:14:25,334 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 18:14:25,334 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 18:14:25,334 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,334 INFO [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 18:14:25,341 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,341 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,341 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 18:14:25,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 18:14:25,341 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:14:25,341 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,341 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,341 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,341 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:14:25,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,341 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,341 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:14:25,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,342 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:14:25,342 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:14:25,342 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:14:25,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:14:25,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 18:14:25,342 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:14:25,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:14:25,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:14:25,342 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:14:25,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,343 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:14:25,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 18:14:25,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:14:25,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:14:25,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:14:25,346 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:14:25,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 18:14:25,351 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:14:25,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,351 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:14:25,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:14:25,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:14:25,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:14:25,369 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:14:25,369 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:14:25,369 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:14:25,369 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:14:25,369 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:14:25,369 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:14:25,369 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:14:25,370 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:14:25,370 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 18:14:25,370 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,371 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-07-12 18:14:25,371 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,371 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-12 18:14:25,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:14:25,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:14:25,370 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:14:25,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:14:25,370 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:14:25,372 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,372 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:14:25,372 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:14:25,372 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,372 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:14:25,372 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,372 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:14:25,372 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:14:25,372 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,372 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-12 18:14:25,373 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:14:25,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:14:25,372 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,373 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:14:25,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:14:25,374 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:14:25,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:14:25,395 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,398 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,469 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,501 DEBUG [Listener at jenkins-hbase4.apache.org/41393] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 18:14:25,502 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-12 18:14:25,502 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-12 18:14:25,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 18:14:25,503 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,503 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689185665155Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1689185665395 (+240 ms)Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1689185665395Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1689185665395Writing data manifest for emptySnaptb0-testExportWithTargetName at 1689185665420 (+25 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1689185665457 (+37 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689185665502 (+45 ms) 2023-07-12 18:14:25,505 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-12 18:14:25,507 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 348 msec 2023-07-12 18:14:25,519 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34205] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1689185663860.3cc09c852c1c1ab92f2fdae31f4311f2. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 18:14:25,522 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37689] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1689185663860.a1bf139ce3f353f6bf68cb2527c654d6. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 18:14:25,526 DEBUG [Listener at jenkins-hbase4.apache.org/41393] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-12 18:14:25,527 DEBUG [Listener at jenkins-hbase4.apache.org/41393] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1689185663860.3cc09c852c1c1ab92f2fdae31f4311f2. 2023-07-12 18:14:25,527 INFO [Listener at jenkins-hbase4.apache.org/41393] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 18:14:25,542 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-12 18:14:25,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689185665542 (current time:1689185665542). 2023-07-12 18:14:25,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 18:14:25,543 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] zookeeper.ReadOnlyZKClient(139): Connect 0x46d81963 to 127.0.0.1:62122 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 18:14:25,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@140a388a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 18:14:25,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 18:14:25,553 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53116, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 18:14:25,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x46d81963 to 127.0.0.1:62122 2023-07-12 18:14:25,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 18:14:25,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] zookeeper.ReadOnlyZKClient(139): Connect 0x4dab3e1d to 127.0.0.1:62122 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 18:14:25,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4bbe35ca, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 18:14:25,561 DEBUG [hconnection-0xeb58a5f-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 18:14:25,562 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53124, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 18:14:25,567 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4dab3e1d to 127.0.0.1:62122 2023-07-12 18:14:25,568 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 18:14:25,568 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-12 18:14:25,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 18:14:25,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-12 18:14:25,572 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-12 18:14:25,573 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-12 18:14:25,574 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689186265574 2023-07-12 18:14:25,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-12 18:14:25,574 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-12 18:14:25,575 DEBUG [Listener at jenkins-hbase4.apache.org/41393] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 18:14:25,576 DEBUG [Listener at jenkins-hbase4.apache.org/41393] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 18:14:25,577 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-12 18:14:25,577 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-12 18:14:25,578 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 6 msec 2023-07-12 18:14:25,579 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-12 18:14:25,580 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689186265580 2023-07-12 18:14:25,598 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-07-12 18:14:25,598 INFO [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-07-12 18:14:25,598 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 18:14:25,599 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-07-12 18:14:25,599 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-12 18:14:25,600 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 18:14:25,600 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-12 18:14:25,601 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:14:25,601 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:14:25,601 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:14:25,601 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:14:25,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:14:25,601 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:14:25,601 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:14:25,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:14:25,601 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:14:25,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:14:25,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-12 18:14:25,602 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:14:25,602 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:14:25,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-12 18:14:25,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-12 18:14:25,602 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:14:25,602 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 18:14:25,602 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 18:14:25,602 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 18:14:25,602 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 18:14:25,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-12 18:14:25,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-12 18:14:25,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-12 18:14:25,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-12 18:14:25,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-12 18:14:25,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-12 18:14:25,603 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-12 18:14:25,603 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-12 18:14:25,603 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-12 18:14:25,603 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-12 18:14:25,603 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-12 18:14:25,603 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-12 18:14:25,603 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-12 18:14:25,604 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-12 18:14:25,604 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 18:14:25,603 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-12 18:14:25,605 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-12 18:14:25,605 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-12 18:14:25,605 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 18:14:25,604 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 18:14:25,605 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-12 18:14:25,606 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-12 18:14:25,606 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-12 18:14:25,606 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-12 18:14:25,606 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37689,1689185653014' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-12 18:14:25,605 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34205,1689185653087' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-12 18:14:25,606 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34493,1689185653159' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-12 18:14:25,609 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:14:25,609 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 18:14:25,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:14:25,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 18:14:25,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 18:14:25,609 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 18:14:25,609 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:14:25,609 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 18:14:25,610 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 18:14:25,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 18:14:25,610 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 18:14:25,609 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 18:14:25,610 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 18:14:25,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 18:14:25,610 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 18:14:25,610 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 18:14:25,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-12 18:14:25,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:14:25,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:14:25,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:14:25,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 18:14:25,612 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34205,1689185653087' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-12 18:14:25,612 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6ad6a2ab[Count = 1] remaining members to acquire global barrier 2023-07-12 18:14:25,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:14:25,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 18:14:25,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 18:14:25,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 18:14:25,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 18:14:25,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-12 18:14:25,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:14:25,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:14:25,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:14:25,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 18:14:25,614 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37689,1689185653014' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-12 18:14:25,614 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6ad6a2ab[Count = 0] remaining members to acquire global barrier 2023-07-12 18:14:25,614 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-12 18:14:25,614 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 18:14:25,620 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 18:14:25,620 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 18:14:25,620 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 18:14:25,621 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 18:14:25,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 18:14:25,620 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 18:14:25,621 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-12 18:14:25,621 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:14:25,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 18:14:25,621 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 18:14:25,621 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 18:14:25,621 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 18:14:25,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 18:14:25,621 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-12 18:14:25,621 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-12 18:14:25,621 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:14:25,621 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 18:14:25,621 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-12 18:14:25,621 DEBUG [rs(jenkins-hbase4.apache.org,34205,1689185653087)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689185663860.3cc09c852c1c1ab92f2fdae31f4311f2. 2023-07-12 18:14:25,621 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 18:14:25,621 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 18:14:25,621 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,34493,1689185653159' in zk 2023-07-12 18:14:25,621 DEBUG [rs(jenkins-hbase4.apache.org,34205,1689185653087)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689185663860.3cc09c852c1c1ab92f2fdae31f4311f2. started... 2023-07-12 18:14:25,621 DEBUG [rs(jenkins-hbase4.apache.org,37689,1689185653014)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689185663860.a1bf139ce3f353f6bf68cb2527c654d6. 2023-07-12 18:14:25,622 DEBUG [rs(jenkins-hbase4.apache.org,37689,1689185653014)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689185663860.a1bf139ce3f353f6bf68cb2527c654d6. started... 2023-07-12 18:14:25,622 INFO [rs(jenkins-hbase4.apache.org,34205,1689185653087)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 3cc09c852c1c1ab92f2fdae31f4311f2 1/1 column families, dataSize=333 B heapSize=976 B 2023-07-12 18:14:25,622 INFO [rs(jenkins-hbase4.apache.org,37689,1689185653014)-snapshot-pool-0] regionserver.HRegion(2745): Flushing a1bf139ce3f353f6bf68cb2527c654d6 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-07-12 18:14:25,624 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-12 18:14:25,624 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 18:14:25,624 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-12 18:14:25,676 DEBUG [Listener at jenkins-hbase4.apache.org/41393] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 18:14:25,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-12 18:14:25,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-12 18:14:25,678 DEBUG [Listener at jenkins-hbase4.apache.org/41393] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 18:14:25,773 INFO [rs(jenkins-hbase4.apache.org,37689,1689185653014)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230712f78ef35f22ba47aa887ce3672382e772 to hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230712f78ef35f22ba47aa887ce3672382e772 2023-07-12 18:14:25,773 INFO [rs(jenkins-hbase4.apache.org,34205,1689185653087)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023071276beac777737451aacb33a825ef470ac to hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e2023071276beac777737451aacb33a825ef470ac 2023-07-12 18:14:25,815 INFO [rs(jenkins-hbase4.apache.org,37689,1689185653014)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testExportWithTargetName/a1bf139ce3f353f6bf68cb2527c654d6/.tmp/cf/6fe3d17d81924e178d9aca87dcf6d8ae 2023-07-12 18:14:25,815 INFO [rs(jenkins-hbase4.apache.org,34205,1689185653087)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testExportWithTargetName/3cc09c852c1c1ab92f2fdae31f4311f2/.tmp/cf/99551a21c0f847b2ae32a796273fc41e 2023-07-12 18:14:25,829 DEBUG [rs(jenkins-hbase4.apache.org,34205,1689185653087)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testExportWithTargetName/3cc09c852c1c1ab92f2fdae31f4311f2/.tmp/cf/99551a21c0f847b2ae32a796273fc41e as hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testExportWithTargetName/3cc09c852c1c1ab92f2fdae31f4311f2/cf/99551a21c0f847b2ae32a796273fc41e 2023-07-12 18:14:25,835 DEBUG [rs(jenkins-hbase4.apache.org,37689,1689185653014)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testExportWithTargetName/a1bf139ce3f353f6bf68cb2527c654d6/.tmp/cf/6fe3d17d81924e178d9aca87dcf6d8ae as hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testExportWithTargetName/a1bf139ce3f353f6bf68cb2527c654d6/cf/6fe3d17d81924e178d9aca87dcf6d8ae 2023-07-12 18:14:25,840 INFO [rs(jenkins-hbase4.apache.org,34205,1689185653087)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testExportWithTargetName/3cc09c852c1c1ab92f2fdae31f4311f2/cf/99551a21c0f847b2ae32a796273fc41e, entries=5, sequenceid=6, filesize=5.7 K 2023-07-12 18:14:25,844 INFO [rs(jenkins-hbase4.apache.org,34205,1689185653087)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for 3cc09c852c1c1ab92f2fdae31f4311f2 in 222ms, sequenceid=6, compaction requested=false 2023-07-12 18:14:25,844 DEBUG [rs(jenkins-hbase4.apache.org,34205,1689185653087)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-12 18:14:25,845 DEBUG [rs(jenkins-hbase4.apache.org,34205,1689185653087)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 3cc09c852c1c1ab92f2fdae31f4311f2: 2023-07-12 18:14:25,845 DEBUG [rs(jenkins-hbase4.apache.org,34205,1689185653087)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689185663860.3cc09c852c1c1ab92f2fdae31f4311f2.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-12 18:14:25,845 DEBUG [rs(jenkins-hbase4.apache.org,34205,1689185653087)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 18:14:25,846 DEBUG [rs(jenkins-hbase4.apache.org,34205,1689185653087)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testExportWithTargetName/3cc09c852c1c1ab92f2fdae31f4311f2/cf/99551a21c0f847b2ae32a796273fc41e] hfiles 2023-07-12 18:14:25,846 DEBUG [rs(jenkins-hbase4.apache.org,34205,1689185653087)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testExportWithTargetName/3cc09c852c1c1ab92f2fdae31f4311f2/cf/99551a21c0f847b2ae32a796273fc41e for snapshot=snaptb0-testExportWithTargetName 2023-07-12 18:14:25,846 INFO [rs(jenkins-hbase4.apache.org,37689,1689185653014)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testExportWithTargetName/a1bf139ce3f353f6bf68cb2527c654d6/cf/6fe3d17d81924e178d9aca87dcf6d8ae, entries=45, sequenceid=6, filesize=12.5 K 2023-07-12 18:14:25,850 INFO [rs(jenkins-hbase4.apache.org,37689,1689185653014)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for a1bf139ce3f353f6bf68cb2527c654d6 in 228ms, sequenceid=6, compaction requested=false 2023-07-12 18:14:25,852 DEBUG [rs(jenkins-hbase4.apache.org,37689,1689185653014)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a1bf139ce3f353f6bf68cb2527c654d6: 2023-07-12 18:14:25,852 DEBUG [rs(jenkins-hbase4.apache.org,37689,1689185653014)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689185663860.a1bf139ce3f353f6bf68cb2527c654d6.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-12 18:14:25,852 DEBUG [rs(jenkins-hbase4.apache.org,37689,1689185653014)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 18:14:25,852 DEBUG [rs(jenkins-hbase4.apache.org,37689,1689185653014)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testExportWithTargetName/a1bf139ce3f353f6bf68cb2527c654d6/cf/6fe3d17d81924e178d9aca87dcf6d8ae] hfiles 2023-07-12 18:14:25,852 DEBUG [rs(jenkins-hbase4.apache.org,37689,1689185653014)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testExportWithTargetName/a1bf139ce3f353f6bf68cb2527c654d6/cf/6fe3d17d81924e178d9aca87dcf6d8ae for snapshot=snaptb0-testExportWithTargetName 2023-07-12 18:14:25,878 DEBUG [Listener at jenkins-hbase4.apache.org/41393] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 18:14:25,881 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-12 18:14:25,883 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-12 18:14:25,883 DEBUG [Listener at jenkins-hbase4.apache.org/41393] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-12 18:14:25,890 DEBUG [rs(jenkins-hbase4.apache.org,37689,1689185653014)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689185663860.a1bf139ce3f353f6bf68cb2527c654d6. completed. 2023-07-12 18:14:25,890 DEBUG [rs(jenkins-hbase4.apache.org,37689,1689185653014)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689185663860.a1bf139ce3f353f6bf68cb2527c654d6. 2023-07-12 18:14:25,891 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 18:14:25,891 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 18:14:25,891 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:14:25,891 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-12 18:14:25,891 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,37689,1689185653014' in zk 2023-07-12 18:14:25,893 DEBUG [rs(jenkins-hbase4.apache.org,34205,1689185653087)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689185663860.3cc09c852c1c1ab92f2fdae31f4311f2. completed. 2023-07-12 18:14:25,893 DEBUG [rs(jenkins-hbase4.apache.org,34205,1689185653087)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689185663860.3cc09c852c1c1ab92f2fdae31f4311f2. 2023-07-12 18:14:25,893 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 18:14:25,893 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 18:14:25,893 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:14:25,893 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:14:25,893 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-12 18:14:25,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:14:25,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 18:14:25,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 18:14:25,893 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-12 18:14:25,893 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,34205,1689185653087' in zk 2023-07-12 18:14:25,893 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 18:14:25,894 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-12 18:14:25,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 18:14:25,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 18:14:25,896 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:14:25,896 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-12 18:14:25,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-12 18:14:25,896 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 18:14:25,896 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-12 18:14:25,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:14:25,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:14:25,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:14:25,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 18:14:25,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-12 18:14:25,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:14:25,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:14:25,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:14:25,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,37689,1689185653014': 2023-07-12 18:14:25,901 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37689,1689185653014' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-12 18:14:25,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:14:25,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 18:14:25,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 18:14:25,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 18:14:25,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 18:14:25,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-12 18:14:25,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:14:25,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:14:25,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:14:25,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 18:14:25,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-12 18:14:25,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:14:25,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:14:25,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:14:25,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,34205,1689185653087': 2023-07-12 18:14:25,906 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34205,1689185653087' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-12 18:14:25,906 INFO [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-07-12 18:14:25,906 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 18:14:25,906 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 18:14:25,907 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-07-12 18:14:25,907 INFO [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 18:14:25,910 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 18:14:25,910 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 18:14:25,910 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:14:25,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 18:14:25,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 18:14:25,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 18:14:25,910 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 18:14:25,910 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 18:14:25,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 18:14:25,910 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 18:14:25,910 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:14:25,910 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 18:14:25,910 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:14:25,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 18:14:25,910 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 18:14:25,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 18:14:25,911 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:14:25,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 18:14:25,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:14:25,911 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:14:25,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:14:25,911 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:14:25,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:14:25,912 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:14:25,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 18:14:25,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 18:14:25,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 18:14:25,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-12 18:14:25,915 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:14:25,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 18:14:25,915 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:14:25,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-12 18:14:25,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:14:25,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:14:25,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:14:25,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 18:14:25,918 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:14:25,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-12 18:14:25,918 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:14:25,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:14:25,919 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:14:25,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:14:25,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:14:25,930 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:14:25,930 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-12 18:14:25,930 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:14:25,930 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:14:25,930 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:14:25,930 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:14:25,930 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:14:25,930 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:14:25,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:14:25,930 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:14:25,930 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:14:25,930 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:14:25,930 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:14:25,930 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:14:25,930 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-12 18:14:25,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:14:25,931 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:14:25,931 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 18:14:25,931 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:14:25,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:14:25,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:14:25,931 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:14:25,931 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:14:25,931 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 18:14:25,931 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:14:25,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:14:25,931 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 18:14:25,932 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:14:25,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:14:25,932 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-07-12 18:14:25,932 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 18:14:25,932 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-07-12 18:14:25,933 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-12 18:14:25,933 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-12 18:14:25,934 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230712f78ef35f22ba47aa887ce3672382e772, hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e2023071276beac777737451aacb33a825ef470ac] mob files 2023-07-12 18:14:25,934 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230712f78ef35f22ba47aa887ce3672382e772 2023-07-12 18:14:25,934 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e2023071276beac777737451aacb33a825ef470ac 2023-07-12 18:14:25,983 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-07-12 18:14:25,985 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-12 18:14:26,021 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-12 18:14:26,184 DEBUG [Listener at jenkins-hbase4.apache.org/41393] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 18:14:26,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-12 18:14:26,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-12 18:14:26,188 DEBUG [Listener at jenkins-hbase4.apache.org/41393] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-12 18:14:26,485 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-12 18:14:26,485 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-12 18:14:26,485 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-12 18:14:26,485 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689185665574Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1689185665983 (+409 ms)Consolidate snapshot: snaptb0-testExportWithTargetName at 1689185665983Loading Region manifests for snaptb0-testExportWithTargetName at 1689185665984 (+1 ms)Writing data manifest for snaptb0-testExportWithTargetName at 1689185665993 (+9 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1689185666009 (+16 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689185666485 (+476 ms) 2023-07-12 18:14:26,489 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-12 18:14:26,491 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 914 msec 2023-07-12 18:14:26,688 DEBUG [Listener at jenkins-hbase4.apache.org/41393] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 18:14:26,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-12 18:14:26,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 18:14:26,692 INFO [Listener at jenkins-hbase4.apache.org/41393] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/export-test/export-1689185666692 2023-07-12 18:14:26,693 INFO [Listener at jenkins-hbase4.apache.org/41393] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:38679, tgtDir=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/export-test/export-1689185666692, rawTgtDir=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/export-test/export-1689185666692, srcFsUri=hdfs://localhost:38679, srcDir=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0 2023-07-12 18:14:26,741 DEBUG [Listener at jenkins-hbase4.apache.org/41393] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:38679, inputRoot=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0 2023-07-12 18:14:26,741 DEBUG [Listener at jenkins-hbase4.apache.org/41393] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1481761388_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/export-test/export-1689185666692, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/export-test/export-1689185666692/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-12 18:14:26,741 INFO [Listener at jenkins-hbase4.apache.org/41393] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:38679, inputRoot=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0, snapshotDir=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-07-12 18:14:26,765 INFO [Listener at jenkins-hbase4.apache.org/41393] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/export-test/export-1689185666692/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-12 18:14:26,870 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-12 18:14:26,871 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-12 18:14:26,871 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-12 18:14:26,871 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-12 18:14:27,878 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/908563f7-ecc5-f8cf-2e08-f8e1a8353ad0/hadoop-3380865592627799731.jar 2023-07-12 18:14:27,879 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-12 18:14:27,879 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-12 18:14:27,948 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/908563f7-ecc5-f8cf-2e08-f8e1a8353ad0/hadoop-4275716521404423986.jar 2023-07-12 18:14:27,948 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-12 18:14:27,949 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-12 18:14:27,949 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-12 18:14:27,950 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-12 18:14:27,950 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-12 18:14:27,950 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-12 18:14:27,951 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-12 18:14:27,951 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-12 18:14:27,952 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-12 18:14:27,952 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-12 18:14:27,953 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-12 18:14:27,954 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-12 18:14:27,954 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-12 18:14:27,954 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-12 18:14:27,955 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-12 18:14:27,956 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-12 18:14:27,960 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 18:14:27,960 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 18:14:27,960 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 18:14:27,961 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 18:14:27,961 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 18:14:27,962 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 18:14:27,962 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 18:14:29,067 WARN [Listener at jenkins-hbase4.apache.org/41393] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-12 18:14:29,074 INFO [Listener at jenkins-hbase4.apache.org/41393] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-07-12 18:14:29,086 DEBUG [Listener at jenkins-hbase4.apache.org/41393] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-07-12 18:14:29,894 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-12 18:14:30,087 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 18:14:30,087 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 18:14:30,541 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689185662417_0001_000001 (auth:SIMPLE) 2023-07-12 18:14:36,129 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689185662417_0001_000001 (auth:SIMPLE) 2023-07-12 18:14:38,496 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689185662417_0001_000001 (auth:SIMPLE) 2023-07-12 18:14:41,708 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689185662417_0001_000001 (auth:SIMPLE) 2023-07-12 18:14:43,512 INFO [Listener at jenkins-hbase4.apache.org/41393] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-12 18:14:43,515 INFO [Listener at jenkins-hbase4.apache.org/41393] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-12 18:14:43,525 INFO [Listener at jenkins-hbase4.apache.org/41393] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-07-12 18:14:43,525 INFO [Listener at jenkins-hbase4.apache.org/41393] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-12 18:14:43,526 INFO [Listener at jenkins-hbase4.apache.org/41393] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-12 18:14:43,526 DEBUG [Listener at jenkins-hbase4.apache.org/41393] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-639947816_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-12 18:14:43,526 DEBUG [Listener at jenkins-hbase4.apache.org/41393] snapshot.TestExportSnapshot(367): hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-07-12 18:14:43,527 DEBUG [Listener at jenkins-hbase4.apache.org/41393] snapshot.TestExportSnapshot(367): hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-07-12 18:14:43,527 DEBUG [Listener at jenkins-hbase4.apache.org/41393] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-639947816_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/export-test/export-1689185666692/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/export-test/export-1689185666692/.hbase-snapshot/testExportWithTargetName 2023-07-12 18:14:43,527 DEBUG [Listener at jenkins-hbase4.apache.org/41393] snapshot.TestExportSnapshot(367): hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/export-test/export-1689185666692/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-07-12 18:14:43,527 DEBUG [Listener at jenkins-hbase4.apache.org/41393] snapshot.TestExportSnapshot(367): hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/export-test/export-1689185666692/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-07-12 18:14:43,537 INFO [Listener at jenkins-hbase4.apache.org/41393] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-07-12 18:14:43,542 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-07-12 18:14:43,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] procedure2.ProcedureExecutor(1029): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-07-12 18:14:43,554 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689185683554"}]},"ts":"1689185683554"} 2023-07-12 18:14:43,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-12 18:14:43,556 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-07-12 18:14:43,577 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-07-12 18:14:43,579 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=3cc09c852c1c1ab92f2fdae31f4311f2, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=a1bf139ce3f353f6bf68cb2527c654d6, UNASSIGN}] 2023-07-12 18:14:43,582 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=3cc09c852c1c1ab92f2fdae31f4311f2, UNASSIGN 2023-07-12 18:14:43,582 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=a1bf139ce3f353f6bf68cb2527c654d6, UNASSIGN 2023-07-12 18:14:43,583 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=3cc09c852c1c1ab92f2fdae31f4311f2, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:14:43,583 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=a1bf139ce3f353f6bf68cb2527c654d6, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:14:43,583 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689185663860.3cc09c852c1c1ab92f2fdae31f4311f2.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689185683583"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689185683583"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689185683583"}]},"ts":"1689185683583"} 2023-07-12 18:14:43,583 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689185663860.a1bf139ce3f353f6bf68cb2527c654d6.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689185683583"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689185683583"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689185683583"}]},"ts":"1689185683583"} 2023-07-12 18:14:43,585 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=22, state=RUNNABLE; CloseRegionProcedure 3cc09c852c1c1ab92f2fdae31f4311f2, server=jenkins-hbase4.apache.org,34205,1689185653087}] 2023-07-12 18:14:43,586 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=23, state=RUNNABLE; CloseRegionProcedure a1bf139ce3f353f6bf68cb2527c654d6, server=jenkins-hbase4.apache.org,37689,1689185653014}] 2023-07-12 18:14:43,656 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-12 18:14:43,747 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 3cc09c852c1c1ab92f2fdae31f4311f2 2023-07-12 18:14:43,747 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close a1bf139ce3f353f6bf68cb2527c654d6 2023-07-12 18:14:43,748 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing a1bf139ce3f353f6bf68cb2527c654d6, disabling compactions & flushes 2023-07-12 18:14:43,748 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 3cc09c852c1c1ab92f2fdae31f4311f2, disabling compactions & flushes 2023-07-12 18:14:43,748 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689185663860.a1bf139ce3f353f6bf68cb2527c654d6. 2023-07-12 18:14:43,748 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689185663860.3cc09c852c1c1ab92f2fdae31f4311f2. 2023-07-12 18:14:43,748 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689185663860.a1bf139ce3f353f6bf68cb2527c654d6. 2023-07-12 18:14:43,748 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689185663860.3cc09c852c1c1ab92f2fdae31f4311f2. 2023-07-12 18:14:43,748 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689185663860.a1bf139ce3f353f6bf68cb2527c654d6. after waiting 0 ms 2023-07-12 18:14:43,748 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689185663860.3cc09c852c1c1ab92f2fdae31f4311f2. after waiting 0 ms 2023-07-12 18:14:43,748 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689185663860.3cc09c852c1c1ab92f2fdae31f4311f2. 2023-07-12 18:14:43,748 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689185663860.a1bf139ce3f353f6bf68cb2527c654d6. 2023-07-12 18:14:43,763 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testExportWithTargetName/a1bf139ce3f353f6bf68cb2527c654d6/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 18:14:43,763 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testExportWithTargetName/3cc09c852c1c1ab92f2fdae31f4311f2/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 18:14:43,764 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 18:14:43,765 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689185663860.a1bf139ce3f353f6bf68cb2527c654d6. 2023-07-12 18:14:43,765 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for a1bf139ce3f353f6bf68cb2527c654d6: 2023-07-12 18:14:43,765 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 18:14:43,766 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689185663860.3cc09c852c1c1ab92f2fdae31f4311f2. 2023-07-12 18:14:43,766 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 3cc09c852c1c1ab92f2fdae31f4311f2: 2023-07-12 18:14:43,768 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed a1bf139ce3f353f6bf68cb2527c654d6 2023-07-12 18:14:43,769 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=a1bf139ce3f353f6bf68cb2527c654d6, regionState=CLOSED 2023-07-12 18:14:43,770 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689185663860.a1bf139ce3f353f6bf68cb2527c654d6.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689185683769"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689185683769"}]},"ts":"1689185683769"} 2023-07-12 18:14:43,771 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 3cc09c852c1c1ab92f2fdae31f4311f2 2023-07-12 18:14:43,771 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=3cc09c852c1c1ab92f2fdae31f4311f2, regionState=CLOSED 2023-07-12 18:14:43,771 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689185663860.3cc09c852c1c1ab92f2fdae31f4311f2.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689185683771"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689185683771"}]},"ts":"1689185683771"} 2023-07-12 18:14:43,776 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=23 2023-07-12 18:14:43,776 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=23, state=SUCCESS; CloseRegionProcedure a1bf139ce3f353f6bf68cb2527c654d6, server=jenkins-hbase4.apache.org,37689,1689185653014 in 186 msec 2023-07-12 18:14:43,777 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=22 2023-07-12 18:14:43,777 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=22, state=SUCCESS; CloseRegionProcedure 3cc09c852c1c1ab92f2fdae31f4311f2, server=jenkins-hbase4.apache.org,34205,1689185653087 in 189 msec 2023-07-12 18:14:43,779 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=a1bf139ce3f353f6bf68cb2527c654d6, UNASSIGN in 197 msec 2023-07-12 18:14:43,782 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=21 2023-07-12 18:14:43,782 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=3cc09c852c1c1ab92f2fdae31f4311f2, UNASSIGN in 198 msec 2023-07-12 18:14:43,784 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689185683784"}]},"ts":"1689185683784"} 2023-07-12 18:14:43,786 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-07-12 18:14:43,854 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-07-12 18:14:43,857 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 310 msec 2023-07-12 18:14:43,857 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-12 18:14:43,858 INFO [Listener at jenkins-hbase4.apache.org/41393] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-07-12 18:14:43,862 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-07-12 18:14:43,869 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-12 18:14:43,872 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-12 18:14:43,874 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-07-12 18:14:43,875 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-12 18:14:43,878 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34493] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-07-12 18:14:43,882 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testExportWithTargetName/3cc09c852c1c1ab92f2fdae31f4311f2 2023-07-12 18:14:43,883 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testExportWithTargetName/a1bf139ce3f353f6bf68cb2527c654d6 2023-07-12 18:14:43,888 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testExportWithTargetName/3cc09c852c1c1ab92f2fdae31f4311f2/cf, FileablePath, hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testExportWithTargetName/3cc09c852c1c1ab92f2fdae31f4311f2/recovered.edits] 2023-07-12 18:14:43,888 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testExportWithTargetName/a1bf139ce3f353f6bf68cb2527c654d6/cf, FileablePath, hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testExportWithTargetName/a1bf139ce3f353f6bf68cb2527c654d6/recovered.edits] 2023-07-12 18:14:43,897 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testExportWithTargetName/a1bf139ce3f353f6bf68cb2527c654d6/cf/6fe3d17d81924e178d9aca87dcf6d8ae to hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/archive/data/default/testtb-testExportWithTargetName/a1bf139ce3f353f6bf68cb2527c654d6/cf/6fe3d17d81924e178d9aca87dcf6d8ae 2023-07-12 18:14:43,898 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testExportWithTargetName/3cc09c852c1c1ab92f2fdae31f4311f2/cf/99551a21c0f847b2ae32a796273fc41e to hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/archive/data/default/testtb-testExportWithTargetName/3cc09c852c1c1ab92f2fdae31f4311f2/cf/99551a21c0f847b2ae32a796273fc41e 2023-07-12 18:14:43,903 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testExportWithTargetName/3cc09c852c1c1ab92f2fdae31f4311f2/recovered.edits/9.seqid to hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/archive/data/default/testtb-testExportWithTargetName/3cc09c852c1c1ab92f2fdae31f4311f2/recovered.edits/9.seqid 2023-07-12 18:14:43,903 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testExportWithTargetName/a1bf139ce3f353f6bf68cb2527c654d6/recovered.edits/9.seqid to hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/archive/data/default/testtb-testExportWithTargetName/a1bf139ce3f353f6bf68cb2527c654d6/recovered.edits/9.seqid 2023-07-12 18:14:43,903 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testExportWithTargetName/3cc09c852c1c1ab92f2fdae31f4311f2 2023-07-12 18:14:43,904 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testExportWithTargetName/a1bf139ce3f353f6bf68cb2527c654d6 2023-07-12 18:14:43,904 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-12 18:14:43,904 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-07-12 18:14:43,905 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf] 2023-07-12 18:14:43,910 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230712f78ef35f22ba47aa887ce3672382e772 to hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230712f78ef35f22ba47aa887ce3672382e772 2023-07-12 18:14:43,912 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e2023071276beac777737451aacb33a825ef470ac to hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e2023071276beac777737451aacb33a825ef470ac 2023-07-12 18:14:43,912 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-07-12 18:14:43,915 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-12 18:14:43,946 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-07-12 18:14:43,992 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-12 18:14:43,992 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-12 18:14:43,992 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-12 18:14:43,992 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-12 18:14:43,994 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-12 18:14:43,994 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-12 18:14:43,994 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-12 18:14:43,994 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-12 18:14:43,996 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-07-12 18:14:43,997 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-12 18:14:43,997 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-07-12 18:14:43,998 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1689185663860.3cc09c852c1c1ab92f2fdae31f4311f2.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689185683998"}]},"ts":"9223372036854775807"} 2023-07-12 18:14:43,998 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1689185663860.a1bf139ce3f353f6bf68cb2527c654d6.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689185683998"}]},"ts":"9223372036854775807"} 2023-07-12 18:14:44,000 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-12 18:14:44,000 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 3cc09c852c1c1ab92f2fdae31f4311f2, NAME => 'testtb-testExportWithTargetName,,1689185663860.3cc09c852c1c1ab92f2fdae31f4311f2.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => a1bf139ce3f353f6bf68cb2527c654d6, NAME => 'testtb-testExportWithTargetName,1,1689185663860.a1bf139ce3f353f6bf68cb2527c654d6.', STARTKEY => '1', ENDKEY => ''}] 2023-07-12 18:14:44,000 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-07-12 18:14:44,001 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689185684001"}]},"ts":"9223372036854775807"} 2023-07-12 18:14:44,003 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-07-12 18:14:44,061 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-12 18:14:44,061 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-12 18:14:44,061 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-12 18:14:44,061 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 18:14:44,061 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-12 18:14:44,061 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 18:14:44,061 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 18:14:44,061 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 18:14:44,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-12 18:14:44,131 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-12 18:14:44,133 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 268 msec 2023-07-12 18:14:44,166 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-12 18:14:44,166 INFO [Listener at jenkins-hbase4.apache.org/41393] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-07-12 18:14:44,189 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-07-12 18:14:44,192 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:44,196 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-07-12 18:14:44,198 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-07-12 18:14:44,237 INFO [Listener at jenkins-hbase4.apache.org/41393] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=752 (was 702) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x30e4ce87-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/908563f7-ecc5-f8cf-2e08-f8e1a8353ad0/cluster_816eff0a-2a97-4927-37b9-33079a1e6298/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-639947816_17 at /127.0.0.1:51134 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-639947816_17 at /127.0.0.1:57114 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x30e4ce87-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/908563f7-ecc5-f8cf-2e08-f8e1a8353ad0/cluster_816eff0a-2a97-4927-37b9-33079a1e6298/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/908563f7-ecc5-f8cf-2e08-f8e1a8353ad0/cluster_816eff0a-2a97-4927-37b9-33079a1e6298/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1506713691) connection to jenkins-hbase4.apache.org/172.31.14.131:39815 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/908563f7-ecc5-f8cf-2e08-f8e1a8353ad0/cluster_816eff0a-2a97-4927-37b9-33079a1e6298/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_672705408_1 at /127.0.0.1:55632 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: RS-EventLoopGroup-4-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/908563f7-ecc5-f8cf-2e08-f8e1a8353ad0/cluster_816eff0a-2a97-4927-37b9-33079a1e6298/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1315 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: IPC Client (1506713691) connection to jenkins-hbase4.apache.org/172.31.14.131:46565 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/908563f7-ecc5-f8cf-2e08-f8e1a8353ad0/cluster_816eff0a-2a97-4927-37b9-33079a1e6298/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x30e4ce87-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-639947816_17 at /127.0.0.1:55652 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x30e4ce87-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_672705408_1 at /127.0.0.1:51112 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=917 (was 889) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=371 (was 284) - SystemLoadAverage LEAK? -, ProcessCount=179 (was 173) - ProcessCount LEAK? -, AvailableMemoryMB=5213 (was 6923) 2023-07-12 18:14:44,238 WARN [Listener at jenkins-hbase4.apache.org/41393] hbase.ResourceChecker(130): Thread=752 is superior to 500 2023-07-12 18:14:44,261 INFO [Listener at jenkins-hbase4.apache.org/41393] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=752, OpenFileDescriptor=917, MaxFileDescriptor=60000, SystemLoadAverage=371, ProcessCount=179, AvailableMemoryMB=5213 2023-07-12 18:14:44,261 WARN [Listener at jenkins-hbase4.apache.org/41393] hbase.ResourceChecker(130): Thread=752 is superior to 500 2023-07-12 18:14:44,263 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-12 18:14:44,266 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-07-12 18:14:44,269 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 18:14:44,270 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-07-12 18:14:44,272 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 18:14:44,272 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-12 18:14:44,277 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testExportFileSystemState/3b0286c8f5bd597207713cb344c8a57f 2023-07-12 18:14:44,277 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testExportFileSystemState/8ef0a6ec9ddd6385dcf8b8375acd8d8f 2023-07-12 18:14:44,278 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testExportFileSystemState/3b0286c8f5bd597207713cb344c8a57f empty. 2023-07-12 18:14:44,278 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testExportFileSystemState/8ef0a6ec9ddd6385dcf8b8375acd8d8f empty. 2023-07-12 18:14:44,279 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testExportFileSystemState/3b0286c8f5bd597207713cb344c8a57f 2023-07-12 18:14:44,279 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testExportFileSystemState/8ef0a6ec9ddd6385dcf8b8375acd8d8f 2023-07-12 18:14:44,279 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-12 18:14:44,299 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-12 18:14:44,300 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 3b0286c8f5bd597207713cb344c8a57f, NAME => 'testtb-testExportFileSystemState,,1689185684263.3b0286c8f5bd597207713cb344c8a57f.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp 2023-07-12 18:14:44,301 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 8ef0a6ec9ddd6385dcf8b8375acd8d8f, NAME => 'testtb-testExportFileSystemState,1,1689185684263.8ef0a6ec9ddd6385dcf8b8375acd8d8f.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp 2023-07-12 18:14:44,344 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689185684263.3b0286c8f5bd597207713cb344c8a57f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 18:14:44,348 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 3b0286c8f5bd597207713cb344c8a57f, disabling compactions & flushes 2023-07-12 18:14:44,348 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689185684263.3b0286c8f5bd597207713cb344c8a57f. 2023-07-12 18:14:44,349 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689185684263.3b0286c8f5bd597207713cb344c8a57f. 2023-07-12 18:14:44,349 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689185684263.3b0286c8f5bd597207713cb344c8a57f. after waiting 0 ms 2023-07-12 18:14:44,349 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689185684263.3b0286c8f5bd597207713cb344c8a57f. 2023-07-12 18:14:44,349 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689185684263.3b0286c8f5bd597207713cb344c8a57f. 2023-07-12 18:14:44,349 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 3b0286c8f5bd597207713cb344c8a57f: 2023-07-12 18:14:44,352 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689185684263.8ef0a6ec9ddd6385dcf8b8375acd8d8f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 18:14:44,354 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 8ef0a6ec9ddd6385dcf8b8375acd8d8f, disabling compactions & flushes 2023-07-12 18:14:44,354 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689185684263.8ef0a6ec9ddd6385dcf8b8375acd8d8f. 2023-07-12 18:14:44,354 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689185684263.8ef0a6ec9ddd6385dcf8b8375acd8d8f. 2023-07-12 18:14:44,354 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689185684263.8ef0a6ec9ddd6385dcf8b8375acd8d8f. after waiting 0 ms 2023-07-12 18:14:44,354 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689185684263.8ef0a6ec9ddd6385dcf8b8375acd8d8f. 2023-07-12 18:14:44,354 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689185684263.8ef0a6ec9ddd6385dcf8b8375acd8d8f. 2023-07-12 18:14:44,354 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 8ef0a6ec9ddd6385dcf8b8375acd8d8f: 2023-07-12 18:14:44,358 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 18:14:44,359 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689185684263.3b0286c8f5bd597207713cb344c8a57f.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689185684359"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689185684359"}]},"ts":"1689185684359"} 2023-07-12 18:14:44,360 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689185684263.8ef0a6ec9ddd6385dcf8b8375acd8d8f.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689185684359"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689185684359"}]},"ts":"1689185684359"} 2023-07-12 18:14:44,363 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-12 18:14:44,364 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 18:14:44,365 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689185684364"}]},"ts":"1689185684364"} 2023-07-12 18:14:44,366 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-07-12 18:14:44,373 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-12 18:14:44,461 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-12 18:14:44,463 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 18:14:44,463 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 18:14:44,463 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-12 18:14:44,463 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 18:14:44,463 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=3b0286c8f5bd597207713cb344c8a57f, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=8ef0a6ec9ddd6385dcf8b8375acd8d8f, ASSIGN}] 2023-07-12 18:14:44,467 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=8ef0a6ec9ddd6385dcf8b8375acd8d8f, ASSIGN 2023-07-12 18:14:44,467 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=3b0286c8f5bd597207713cb344c8a57f, ASSIGN 2023-07-12 18:14:44,469 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=8ef0a6ec9ddd6385dcf8b8375acd8d8f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34493,1689185653159; forceNewPlan=false, retain=false 2023-07-12 18:14:44,469 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=3b0286c8f5bd597207713cb344c8a57f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34205,1689185653087; forceNewPlan=false, retain=false 2023-07-12 18:14:44,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-12 18:14:44,619 INFO [jenkins-hbase4:43177] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-12 18:14:44,622 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=8ef0a6ec9ddd6385dcf8b8375acd8d8f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:14:44,622 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=3b0286c8f5bd597207713cb344c8a57f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:14:44,622 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689185684263.3b0286c8f5bd597207713cb344c8a57f.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689185684622"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689185684622"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689185684622"}]},"ts":"1689185684622"} 2023-07-12 18:14:44,622 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689185684263.8ef0a6ec9ddd6385dcf8b8375acd8d8f.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689185684622"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689185684622"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689185684622"}]},"ts":"1689185684622"} 2023-07-12 18:14:44,624 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=29, state=RUNNABLE; OpenRegionProcedure 8ef0a6ec9ddd6385dcf8b8375acd8d8f, server=jenkins-hbase4.apache.org,34493,1689185653159}] 2023-07-12 18:14:44,626 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=28, state=RUNNABLE; OpenRegionProcedure 3b0286c8f5bd597207713cb344c8a57f, server=jenkins-hbase4.apache.org,34205,1689185653087}] 2023-07-12 18:14:44,788 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1689185684263.3b0286c8f5bd597207713cb344c8a57f. 2023-07-12 18:14:44,788 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1689185684263.8ef0a6ec9ddd6385dcf8b8375acd8d8f. 2023-07-12 18:14:44,788 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 3b0286c8f5bd597207713cb344c8a57f, NAME => 'testtb-testExportFileSystemState,,1689185684263.3b0286c8f5bd597207713cb344c8a57f.', STARTKEY => '', ENDKEY => '1'} 2023-07-12 18:14:44,788 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8ef0a6ec9ddd6385dcf8b8375acd8d8f, NAME => 'testtb-testExportFileSystemState,1,1689185684263.8ef0a6ec9ddd6385dcf8b8375acd8d8f.', STARTKEY => '1', ENDKEY => ''} 2023-07-12 18:14:44,788 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1689185684263.3b0286c8f5bd597207713cb344c8a57f. service=AccessControlService 2023-07-12 18:14:44,789 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 18:14:44,789 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 3b0286c8f5bd597207713cb344c8a57f 2023-07-12 18:14:44,789 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689185684263.3b0286c8f5bd597207713cb344c8a57f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 18:14:44,789 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1689185684263.8ef0a6ec9ddd6385dcf8b8375acd8d8f. service=AccessControlService 2023-07-12 18:14:44,789 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 3b0286c8f5bd597207713cb344c8a57f 2023-07-12 18:14:44,789 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 3b0286c8f5bd597207713cb344c8a57f 2023-07-12 18:14:44,789 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 18:14:44,789 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 8ef0a6ec9ddd6385dcf8b8375acd8d8f 2023-07-12 18:14:44,789 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689185684263.8ef0a6ec9ddd6385dcf8b8375acd8d8f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 18:14:44,789 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 8ef0a6ec9ddd6385dcf8b8375acd8d8f 2023-07-12 18:14:44,789 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 8ef0a6ec9ddd6385dcf8b8375acd8d8f 2023-07-12 18:14:44,790 INFO [StoreOpener-3b0286c8f5bd597207713cb344c8a57f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 3b0286c8f5bd597207713cb344c8a57f 2023-07-12 18:14:44,790 INFO [StoreOpener-8ef0a6ec9ddd6385dcf8b8375acd8d8f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 8ef0a6ec9ddd6385dcf8b8375acd8d8f 2023-07-12 18:14:44,792 DEBUG [StoreOpener-3b0286c8f5bd597207713cb344c8a57f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testExportFileSystemState/3b0286c8f5bd597207713cb344c8a57f/cf 2023-07-12 18:14:44,792 DEBUG [StoreOpener-8ef0a6ec9ddd6385dcf8b8375acd8d8f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testExportFileSystemState/8ef0a6ec9ddd6385dcf8b8375acd8d8f/cf 2023-07-12 18:14:44,792 DEBUG [StoreOpener-3b0286c8f5bd597207713cb344c8a57f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testExportFileSystemState/3b0286c8f5bd597207713cb344c8a57f/cf 2023-07-12 18:14:44,792 DEBUG [StoreOpener-8ef0a6ec9ddd6385dcf8b8375acd8d8f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testExportFileSystemState/8ef0a6ec9ddd6385dcf8b8375acd8d8f/cf 2023-07-12 18:14:44,793 INFO [StoreOpener-8ef0a6ec9ddd6385dcf8b8375acd8d8f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8ef0a6ec9ddd6385dcf8b8375acd8d8f columnFamilyName cf 2023-07-12 18:14:44,793 INFO [StoreOpener-3b0286c8f5bd597207713cb344c8a57f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3b0286c8f5bd597207713cb344c8a57f columnFamilyName cf 2023-07-12 18:14:44,795 INFO [StoreOpener-3b0286c8f5bd597207713cb344c8a57f-1] regionserver.HStore(310): Store=3b0286c8f5bd597207713cb344c8a57f/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 18:14:44,795 INFO [StoreOpener-8ef0a6ec9ddd6385dcf8b8375acd8d8f-1] regionserver.HStore(310): Store=8ef0a6ec9ddd6385dcf8b8375acd8d8f/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 18:14:44,802 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testExportFileSystemState/8ef0a6ec9ddd6385dcf8b8375acd8d8f 2023-07-12 18:14:44,803 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testExportFileSystemState/8ef0a6ec9ddd6385dcf8b8375acd8d8f 2023-07-12 18:14:44,807 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 8ef0a6ec9ddd6385dcf8b8375acd8d8f 2023-07-12 18:14:44,807 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testExportFileSystemState/3b0286c8f5bd597207713cb344c8a57f 2023-07-12 18:14:44,808 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testExportFileSystemState/3b0286c8f5bd597207713cb344c8a57f 2023-07-12 18:14:44,810 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testExportFileSystemState/8ef0a6ec9ddd6385dcf8b8375acd8d8f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 18:14:44,811 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 8ef0a6ec9ddd6385dcf8b8375acd8d8f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61707910, jitterRate=-0.08048048615455627}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 18:14:44,811 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 8ef0a6ec9ddd6385dcf8b8375acd8d8f: 2023-07-12 18:14:44,812 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1689185684263.8ef0a6ec9ddd6385dcf8b8375acd8d8f., pid=30, masterSystemTime=1689185684779 2023-07-12 18:14:44,813 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 3b0286c8f5bd597207713cb344c8a57f 2023-07-12 18:14:44,816 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1689185684263.8ef0a6ec9ddd6385dcf8b8375acd8d8f. 2023-07-12 18:14:44,816 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1689185684263.8ef0a6ec9ddd6385dcf8b8375acd8d8f. 2023-07-12 18:14:44,818 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=8ef0a6ec9ddd6385dcf8b8375acd8d8f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:14:44,818 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1689185684263.8ef0a6ec9ddd6385dcf8b8375acd8d8f.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689185684817"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689185684817"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689185684817"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689185684817"}]},"ts":"1689185684817"} 2023-07-12 18:14:44,828 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=29 2023-07-12 18:14:44,828 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=29, state=SUCCESS; OpenRegionProcedure 8ef0a6ec9ddd6385dcf8b8375acd8d8f, server=jenkins-hbase4.apache.org,34493,1689185653159 in 196 msec 2023-07-12 18:14:44,830 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testExportFileSystemState/3b0286c8f5bd597207713cb344c8a57f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 18:14:44,830 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=8ef0a6ec9ddd6385dcf8b8375acd8d8f, ASSIGN in 365 msec 2023-07-12 18:14:44,831 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 3b0286c8f5bd597207713cb344c8a57f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73588086, jitterRate=0.096547931432724}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 18:14:44,831 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 3b0286c8f5bd597207713cb344c8a57f: 2023-07-12 18:14:44,832 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1689185684263.3b0286c8f5bd597207713cb344c8a57f., pid=31, masterSystemTime=1689185684781 2023-07-12 18:14:44,833 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1689185684263.3b0286c8f5bd597207713cb344c8a57f. 2023-07-12 18:14:44,834 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1689185684263.3b0286c8f5bd597207713cb344c8a57f. 2023-07-12 18:14:44,834 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=3b0286c8f5bd597207713cb344c8a57f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:14:44,835 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1689185684263.3b0286c8f5bd597207713cb344c8a57f.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689185684834"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689185684834"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689185684834"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689185684834"}]},"ts":"1689185684834"} 2023-07-12 18:14:44,839 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=28 2023-07-12 18:14:44,840 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=28, state=SUCCESS; OpenRegionProcedure 3b0286c8f5bd597207713cb344c8a57f, server=jenkins-hbase4.apache.org,34205,1689185653087 in 211 msec 2023-07-12 18:14:44,845 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=27 2023-07-12 18:14:44,845 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=3b0286c8f5bd597207713cb344c8a57f, ASSIGN in 377 msec 2023-07-12 18:14:44,847 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 18:14:44,847 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689185684847"}]},"ts":"1689185684847"} 2023-07-12 18:14:44,849 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-07-12 18:14:44,852 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 18:14:44,852 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-07-12 18:14:44,855 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34493] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-12 18:14:44,856 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 18:14:44,857 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 18:14:44,857 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 18:14:44,857 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 18:14:44,858 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-12 18:14:44,858 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-12 18:14:44,858 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-12 18:14:44,859 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-12 18:14:44,863 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 594 msec 2023-07-12 18:14:44,876 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-12 18:14:44,876 INFO [Listener at jenkins-hbase4.apache.org/41393] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-07-12 18:14:44,879 DEBUG [Listener at jenkins-hbase4.apache.org/41393] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-12 18:14:44,879 DEBUG [Listener at jenkins-hbase4.apache.org/41393] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1689185684263.3b0286c8f5bd597207713cb344c8a57f. 2023-07-12 18:14:44,881 INFO [Listener at jenkins-hbase4.apache.org/41393] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 18:14:44,895 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 18:14:44,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689185684895 (current time:1689185684895). 2023-07-12 18:14:44,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 18:14:44,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] zookeeper.ReadOnlyZKClient(139): Connect 0x269cd5e8 to 127.0.0.1:62122 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 18:14:44,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5cd394be, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 18:14:44,904 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 18:14:44,907 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58354, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 18:14:44,908 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x269cd5e8 to 127.0.0.1:62122 2023-07-12 18:14:44,908 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 18:14:44,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] zookeeper.ReadOnlyZKClient(139): Connect 0x2480d358 to 127.0.0.1:62122 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 18:14:44,915 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@64f371b5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 18:14:44,918 DEBUG [hconnection-0x24c56ff1-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 18:14:44,921 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58368, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 18:14:44,927 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2480d358 to 127.0.0.1:62122 2023-07-12 18:14:44,927 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 18:14:44,927 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-12 18:14:44,928 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 18:14:44,928 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 18:14:44,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-12 18:14:44,933 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-12 18:14:44,934 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689186284934 2023-07-12 18:14:44,934 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 18:14:44,934 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-12 18:14:44,935 DEBUG [Listener at jenkins-hbase4.apache.org/41393] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 18:14:44,935 DEBUG [Listener at jenkins-hbase4.apache.org/41393] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 18:14:44,941 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-12 18:14:44,941 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-12 18:14:44,943 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 11 msec 2023-07-12 18:14:44,945 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-12 18:14:44,946 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689186284946 2023-07-12 18:14:44,960 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:44,960 INFO [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-07-12 18:14:44,961 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 18:14:44,962 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-07-12 18:14:44,963 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-12 18:14:44,963 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:44,964 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:44,969 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:14:44,969 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:14:44,969 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:14:44,969 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:14:44,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:14:44,969 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:14:44,970 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:14:44,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:14:44,969 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:14:44,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:14:44,970 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:14:44,970 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:14:44,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:44,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:44,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:44,970 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:14:44,970 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 18:14:44,970 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:44,971 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:44,971 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:44,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-12 18:14:44,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:44,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-12 18:14:44,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:44,971 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-12 18:14:44,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-12 18:14:44,971 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-12 18:14:44,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:44,971 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-12 18:14:44,971 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:44,972 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-12 18:14:44,972 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 18:14:44,972 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:44,973 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-12 18:14:44,973 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-12 18:14:44,972 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:44,973 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 18:14:44,973 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-12 18:14:44,975 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-12 18:14:44,975 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-12 18:14:44,975 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34205,1689185653087' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-12 18:14:44,973 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-12 18:14:44,975 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 18:14:44,975 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34493,1689185653159' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-12 18:14:44,976 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-12 18:14:44,976 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-12 18:14:44,976 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37689,1689185653014' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-12 18:14:44,977 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:44,977 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:14:44,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:14:44,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 18:14:44,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 18:14:44,984 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:14:44,984 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:44,984 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 18:14:44,984 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:44,984 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:44,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 18:14:44,984 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:44,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 18:14:44,984 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 18:14:44,984 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:44,985 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 18:14:44,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:44,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:14:44,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:14:44,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:14:44,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 18:14:44,986 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34205,1689185653087' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-12 18:14:44,986 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@67bc093d[Count = 1] remaining members to acquire global barrier 2023-07-12 18:14:44,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:14:44,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 18:14:44,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 18:14:44,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 18:14:44,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 18:14:44,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:44,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:14:44,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:14:44,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:14:44,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 18:14:44,989 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34493,1689185653159' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-12 18:14:44,989 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@67bc093d[Count = 0] remaining members to acquire global barrier 2023-07-12 18:14:44,989 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-12 18:14:44,989 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:44,990 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:44,990 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:44,990 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:44,990 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:44,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:44,990 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:44,990 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-12 18:14:44,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:44,991 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:14:44,991 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-12 18:14:44,991 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 18:14:44,991 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 18:14:44,990 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:44,991 DEBUG [rs(jenkins-hbase4.apache.org,34493,1689185653159)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689185684263.8ef0a6ec9ddd6385dcf8b8375acd8d8f. 2023-07-12 18:14:44,991 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-12 18:14:44,991 DEBUG [rs(jenkins-hbase4.apache.org,34493,1689185653159)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689185684263.8ef0a6ec9ddd6385dcf8b8375acd8d8f. started... 2023-07-12 18:14:44,991 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:14:44,991 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 18:14:44,991 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,37689,1689185653014' in zk 2023-07-12 18:14:44,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:44,993 DEBUG [rs(jenkins-hbase4.apache.org,34493,1689185653159)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8ef0a6ec9ddd6385dcf8b8375acd8d8f: 2023-07-12 18:14:44,993 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-12 18:14:44,993 DEBUG [rs(jenkins-hbase4.apache.org,34493,1689185653159)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689185684263.8ef0a6ec9ddd6385dcf8b8375acd8d8f.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:44,993 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 18:14:44,993 DEBUG [rs(jenkins-hbase4.apache.org,34493,1689185653159)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 18:14:44,993 DEBUG [rs(jenkins-hbase4.apache.org,34205,1689185653087)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689185684263.3b0286c8f5bd597207713cb344c8a57f. 2023-07-12 18:14:44,993 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 18:14:44,994 DEBUG [rs(jenkins-hbase4.apache.org,34205,1689185653087)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689185684263.3b0286c8f5bd597207713cb344c8a57f. started... 2023-07-12 18:14:44,993 DEBUG [rs(jenkins-hbase4.apache.org,34493,1689185653159)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 18:14:44,994 DEBUG [rs(jenkins-hbase4.apache.org,34205,1689185653087)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 3b0286c8f5bd597207713cb344c8a57f: 2023-07-12 18:14:44,994 DEBUG [rs(jenkins-hbase4.apache.org,34205,1689185653087)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689185684263.3b0286c8f5bd597207713cb344c8a57f.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:44,994 DEBUG [rs(jenkins-hbase4.apache.org,34205,1689185653087)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 18:14:44,994 DEBUG [rs(jenkins-hbase4.apache.org,34205,1689185653087)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 18:14:44,995 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-12 18:14:44,995 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 18:14:44,995 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-12 18:14:45,038 DEBUG [Listener at jenkins-hbase4.apache.org/41393] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 18:14:45,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-12 18:14:45,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-12 18:14:45,040 DEBUG [Listener at jenkins-hbase4.apache.org/41393] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 18:14:45,041 DEBUG [rs(jenkins-hbase4.apache.org,34493,1689185653159)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689185684263.8ef0a6ec9ddd6385dcf8b8375acd8d8f. completed. 2023-07-12 18:14:45,041 DEBUG [rs(jenkins-hbase4.apache.org,34493,1689185653159)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689185684263.8ef0a6ec9ddd6385dcf8b8375acd8d8f. 2023-07-12 18:14:45,042 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 18:14:45,042 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 18:14:45,042 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:14:45,042 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-12 18:14:45,042 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,34493,1689185653159' in zk 2023-07-12 18:14:45,044 DEBUG [rs(jenkins-hbase4.apache.org,34205,1689185653087)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689185684263.3b0286c8f5bd597207713cb344c8a57f. completed. 2023-07-12 18:14:45,044 DEBUG [rs(jenkins-hbase4.apache.org,34205,1689185653087)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689185684263.3b0286c8f5bd597207713cb344c8a57f. 2023-07-12 18:14:45,044 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:14:45,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:14:45,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 18:14:45,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 18:14:45,045 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 18:14:45,045 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 18:14:45,045 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:14:45,045 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-12 18:14:45,045 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,34205,1689185653087' in zk 2023-07-12 18:14:45,045 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-12 18:14:45,045 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 18:14:45,045 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-12 18:14:45,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 18:14:45,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 18:14:45,049 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-12 18:14:45,049 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:14:45,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:45,049 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 18:14:45,049 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-12 18:14:45,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:14:45,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:14:45,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:14:45,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 18:14:45,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:45,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:14:45,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:14:45,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:14:45,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,34493,1689185653159': 2023-07-12 18:14:45,057 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34493,1689185653159' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-12 18:14:45,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:14:45,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 18:14:45,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 18:14:45,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 18:14:45,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 18:14:45,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:45,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:14:45,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:14:45,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:14:45,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 18:14:45,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:45,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:14:45,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:14:45,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:14:45,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,34205,1689185653087': 2023-07-12 18:14:45,062 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34205,1689185653087' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-12 18:14:45,062 INFO [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-07-12 18:14:45,062 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 18:14:45,062 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 18:14:45,062 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:45,062 INFO [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 18:14:45,064 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:45,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:45,065 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:45,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 18:14:45,065 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:45,065 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:45,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:45,065 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:45,065 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:14:45,065 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:45,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:45,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 18:14:45,065 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:14:45,065 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:45,065 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:14:45,065 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:14:45,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:14:45,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:45,066 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:14:45,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:14:45,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:45,066 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:14:45,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 18:14:45,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:14:45,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:45,066 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:14:45,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:45,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:45,067 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:14:45,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 18:14:45,068 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:14:45,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:45,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:14:45,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:14:45,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:14:45,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 18:14:45,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:45,071 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:14:45,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:14:45,071 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:14:45,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:14:45,071 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:14:45,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:14:45,077 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:14:45,077 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:45,077 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:14:45,077 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:14:45,077 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:14:45,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:14:45,078 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:14:45,078 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:14:45,077 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:14:45,078 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:14:45,077 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:14:45,078 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:14:45,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:14:45,078 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:45,078 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-07-12 18:14:45,078 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:14:45,078 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 18:14:45,078 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:14:45,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:14:45,081 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:14:45,081 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:14:45,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:14:45,078 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:45,078 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:45,081 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-12 18:14:45,081 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:14:45,081 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:45,081 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:14:45,081 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:14:45,081 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:45,081 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:45,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:14:45,082 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:14:45,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:14:45,082 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-12 18:14:45,104 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:45,105 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:45,167 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:45,204 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-12 18:14:45,205 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:45,205 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:45,205 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689185684934Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1689185685104 (+170 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1689185685104Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1689185685104Writing data manifest for emptySnaptb0-testExportFileSystemState at 1689185685110 (+6 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1689185685156 (+46 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689185685204 (+48 ms) 2023-07-12 18:14:45,209 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-12 18:14:45,211 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 274 msec 2023-07-12 18:14:45,240 DEBUG [Listener at jenkins-hbase4.apache.org/41393] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 18:14:45,241 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-12 18:14:45,241 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 18:14:45,245 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34205] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1689185684263.3b0286c8f5bd597207713cb344c8a57f. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 18:14:45,247 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34493] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1689185684263.8ef0a6ec9ddd6385dcf8b8375acd8d8f. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 18:14:45,251 DEBUG [Listener at jenkins-hbase4.apache.org/41393] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-12 18:14:45,251 DEBUG [Listener at jenkins-hbase4.apache.org/41393] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1689185684263.3b0286c8f5bd597207713cb344c8a57f. 2023-07-12 18:14:45,252 INFO [Listener at jenkins-hbase4.apache.org/41393] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 18:14:45,267 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 18:14:45,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689185685267 (current time:1689185685267). 2023-07-12 18:14:45,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 18:14:45,268 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] zookeeper.ReadOnlyZKClient(139): Connect 0x4cf89dcf to 127.0.0.1:62122 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 18:14:45,275 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@71271472, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 18:14:45,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 18:14:45,277 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58370, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 18:14:45,278 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4cf89dcf to 127.0.0.1:62122 2023-07-12 18:14:45,278 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 18:14:45,279 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] zookeeper.ReadOnlyZKClient(139): Connect 0x03539165 to 127.0.0.1:62122 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 18:14:45,287 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@428063ba, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 18:14:45,289 DEBUG [hconnection-0x5e4873f5-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 18:14:45,291 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58374, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 18:14:45,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x03539165 to 127.0.0.1:62122 2023-07-12 18:14:45,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 18:14:45,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-12 18:14:45,297 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 18:14:45,297 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 18:14:45,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-12 18:14:45,300 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-12 18:14:45,301 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689186285301 2023-07-12 18:14:45,301 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-12 18:14:45,301 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 18:14:45,302 DEBUG [Listener at jenkins-hbase4.apache.org/41393] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 18:14:45,303 DEBUG [Listener at jenkins-hbase4.apache.org/41393] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 18:14:45,304 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-12 18:14:45,304 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-12 18:14:45,305 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 5 msec 2023-07-12 18:14:45,306 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-12 18:14:45,307 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689186285307 2023-07-12 18:14:45,320 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-07-12 18:14:45,320 INFO [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-07-12 18:14:45,320 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 18:14:45,321 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-07-12 18:14:45,321 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-12 18:14:45,322 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 18:14:45,322 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-12 18:14:45,323 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:14:45,323 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:14:45,323 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:14:45,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:14:45,323 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:14:45,323 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:14:45,323 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:14:45,324 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:14:45,324 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:14:45,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:14:45,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-12 18:14:45,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:14:45,324 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:14:45,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-12 18:14:45,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-12 18:14:45,324 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 18:14:45,324 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:14:45,324 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 18:14:45,324 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 18:14:45,324 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 18:14:45,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-12 18:14:45,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-12 18:14:45,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-12 18:14:45,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-12 18:14:45,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-12 18:14:45,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-12 18:14:45,325 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-12 18:14:45,325 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-12 18:14:45,325 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-12 18:14:45,325 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-12 18:14:45,325 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-12 18:14:45,325 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-12 18:14:45,326 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-12 18:14:45,326 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-12 18:14:45,326 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-12 18:14:45,326 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 18:14:45,325 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 18:14:45,327 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-12 18:14:45,328 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-12 18:14:45,326 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 18:14:45,329 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37689,1689185653014' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-12 18:14:45,328 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-12 18:14:45,329 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-12 18:14:45,329 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-12 18:14:45,329 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34205,1689185653087' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-12 18:14:45,330 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-12 18:14:45,330 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34493,1689185653159' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-12 18:14:45,332 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 18:14:45,333 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 18:14:45,333 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 18:14:45,333 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:14:45,333 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 18:14:45,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:14:45,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 18:14:45,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 18:14:45,333 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 18:14:45,333 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 18:14:45,333 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 18:14:45,333 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 18:14:45,333 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 18:14:45,333 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:14:45,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 18:14:45,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 18:14:45,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-12 18:14:45,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:14:45,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:14:45,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:14:45,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 18:14:45,335 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34205,1689185653087' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-12 18:14:45,335 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@489ce490[Count = 1] remaining members to acquire global barrier 2023-07-12 18:14:45,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:14:45,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 18:14:45,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 18:14:45,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 18:14:45,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 18:14:45,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-12 18:14:45,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:14:45,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:14:45,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:14:45,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 18:14:45,337 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34493,1689185653159' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-12 18:14:45,337 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@489ce490[Count = 0] remaining members to acquire global barrier 2023-07-12 18:14:45,337 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-12 18:14:45,337 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 18:14:45,338 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 18:14:45,338 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 18:14:45,338 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 18:14:45,339 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 18:14:45,339 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 18:14:45,338 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 18:14:45,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 18:14:45,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 18:14:45,339 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-12 18:14:45,339 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:14:45,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 18:14:45,339 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-12 18:14:45,339 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-12 18:14:45,339 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 18:14:45,339 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 18:14:45,339 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-12 18:14:45,339 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 18:14:45,339 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 18:14:45,339 DEBUG [rs(jenkins-hbase4.apache.org,34205,1689185653087)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689185684263.3b0286c8f5bd597207713cb344c8a57f. 2023-07-12 18:14:45,339 DEBUG [rs(jenkins-hbase4.apache.org,34493,1689185653159)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689185684263.8ef0a6ec9ddd6385dcf8b8375acd8d8f. 2023-07-12 18:14:45,339 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,37689,1689185653014' in zk 2023-07-12 18:14:45,339 DEBUG [rs(jenkins-hbase4.apache.org,34493,1689185653159)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689185684263.8ef0a6ec9ddd6385dcf8b8375acd8d8f. started... 2023-07-12 18:14:45,339 DEBUG [rs(jenkins-hbase4.apache.org,34205,1689185653087)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689185684263.3b0286c8f5bd597207713cb344c8a57f. started... 2023-07-12 18:14:45,339 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:14:45,340 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 18:14:45,340 INFO [rs(jenkins-hbase4.apache.org,34205,1689185653087)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 3b0286c8f5bd597207713cb344c8a57f 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-12 18:14:45,340 INFO [rs(jenkins-hbase4.apache.org,34493,1689185653159)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 8ef0a6ec9ddd6385dcf8b8375acd8d8f 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-12 18:14:45,341 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-12 18:14:45,341 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 18:14:45,341 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-12 18:14:45,368 INFO [rs(jenkins-hbase4.apache.org,34205,1689185653087)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307128f521c0b1f7942a283ea9d74813cbe80 to hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202307128f521c0b1f7942a283ea9d74813cbe80 2023-07-12 18:14:45,382 INFO [rs(jenkins-hbase4.apache.org,34493,1689185653159)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202307123f186a39230749ad82762180327a2a28 to hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202307123f186a39230749ad82762180327a2a28 2023-07-12 18:14:45,387 INFO [rs(jenkins-hbase4.apache.org,34205,1689185653087)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testExportFileSystemState/3b0286c8f5bd597207713cb344c8a57f/.tmp/cf/8f1701bda51441608040e868a91fe29b 2023-07-12 18:14:45,396 DEBUG [rs(jenkins-hbase4.apache.org,34205,1689185653087)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testExportFileSystemState/3b0286c8f5bd597207713cb344c8a57f/.tmp/cf/8f1701bda51441608040e868a91fe29b as hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testExportFileSystemState/3b0286c8f5bd597207713cb344c8a57f/cf/8f1701bda51441608040e868a91fe29b 2023-07-12 18:14:45,401 INFO [rs(jenkins-hbase4.apache.org,34493,1689185653159)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testExportFileSystemState/8ef0a6ec9ddd6385dcf8b8375acd8d8f/.tmp/cf/866712a48ad742d9b9948fd79560fc63 2023-07-12 18:14:45,403 DEBUG [Listener at jenkins-hbase4.apache.org/41393] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 18:14:45,404 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-12 18:14:45,404 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-12 18:14:45,405 DEBUG [Listener at jenkins-hbase4.apache.org/41393] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 18:14:45,409 INFO [rs(jenkins-hbase4.apache.org,34205,1689185653087)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testExportFileSystemState/3b0286c8f5bd597207713cb344c8a57f/cf/8f1701bda51441608040e868a91fe29b, entries=4, sequenceid=6, filesize=5.6 K 2023-07-12 18:14:45,409 DEBUG [rs(jenkins-hbase4.apache.org,34493,1689185653159)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testExportFileSystemState/8ef0a6ec9ddd6385dcf8b8375acd8d8f/.tmp/cf/866712a48ad742d9b9948fd79560fc63 as hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testExportFileSystemState/8ef0a6ec9ddd6385dcf8b8375acd8d8f/cf/866712a48ad742d9b9948fd79560fc63 2023-07-12 18:14:45,410 INFO [rs(jenkins-hbase4.apache.org,34205,1689185653087)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 3b0286c8f5bd597207713cb344c8a57f in 70ms, sequenceid=6, compaction requested=false 2023-07-12 18:14:45,410 DEBUG [rs(jenkins-hbase4.apache.org,34205,1689185653087)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-07-12 18:14:45,411 DEBUG [rs(jenkins-hbase4.apache.org,34205,1689185653087)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 3b0286c8f5bd597207713cb344c8a57f: 2023-07-12 18:14:45,411 DEBUG [rs(jenkins-hbase4.apache.org,34205,1689185653087)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689185684263.3b0286c8f5bd597207713cb344c8a57f.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-12 18:14:45,411 DEBUG [rs(jenkins-hbase4.apache.org,34205,1689185653087)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 18:14:45,411 DEBUG [rs(jenkins-hbase4.apache.org,34205,1689185653087)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testExportFileSystemState/3b0286c8f5bd597207713cb344c8a57f/cf/8f1701bda51441608040e868a91fe29b] hfiles 2023-07-12 18:14:45,411 DEBUG [rs(jenkins-hbase4.apache.org,34205,1689185653087)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testExportFileSystemState/3b0286c8f5bd597207713cb344c8a57f/cf/8f1701bda51441608040e868a91fe29b for snapshot=snaptb0-testExportFileSystemState 2023-07-12 18:14:45,416 INFO [rs(jenkins-hbase4.apache.org,34493,1689185653159)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testExportFileSystemState/8ef0a6ec9ddd6385dcf8b8375acd8d8f/cf/866712a48ad742d9b9948fd79560fc63, entries=46, sequenceid=6, filesize=12.7 K 2023-07-12 18:14:45,417 INFO [rs(jenkins-hbase4.apache.org,34493,1689185653159)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 8ef0a6ec9ddd6385dcf8b8375acd8d8f in 77ms, sequenceid=6, compaction requested=false 2023-07-12 18:14:45,419 DEBUG [rs(jenkins-hbase4.apache.org,34493,1689185653159)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8ef0a6ec9ddd6385dcf8b8375acd8d8f: 2023-07-12 18:14:45,419 DEBUG [rs(jenkins-hbase4.apache.org,34493,1689185653159)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689185684263.8ef0a6ec9ddd6385dcf8b8375acd8d8f.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-12 18:14:45,419 DEBUG [rs(jenkins-hbase4.apache.org,34493,1689185653159)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 18:14:45,419 DEBUG [rs(jenkins-hbase4.apache.org,34493,1689185653159)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testExportFileSystemState/8ef0a6ec9ddd6385dcf8b8375acd8d8f/cf/866712a48ad742d9b9948fd79560fc63] hfiles 2023-07-12 18:14:45,419 DEBUG [rs(jenkins-hbase4.apache.org,34493,1689185653159)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testExportFileSystemState/8ef0a6ec9ddd6385dcf8b8375acd8d8f/cf/866712a48ad742d9b9948fd79560fc63 for snapshot=snaptb0-testExportFileSystemState 2023-07-12 18:14:45,424 DEBUG [rs(jenkins-hbase4.apache.org,34205,1689185653087)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689185684263.3b0286c8f5bd597207713cb344c8a57f. completed. 2023-07-12 18:14:45,424 DEBUG [rs(jenkins-hbase4.apache.org,34205,1689185653087)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689185684263.3b0286c8f5bd597207713cb344c8a57f. 2023-07-12 18:14:45,424 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 18:14:45,424 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 18:14:45,424 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:14:45,424 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-12 18:14:45,424 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,34205,1689185653087' in zk 2023-07-12 18:14:45,431 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:14:45,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:14:45,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 18:14:45,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 18:14:45,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 18:14:45,432 DEBUG [rs(jenkins-hbase4.apache.org,34493,1689185653159)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689185684263.8ef0a6ec9ddd6385dcf8b8375acd8d8f. completed. 2023-07-12 18:14:45,432 DEBUG [rs(jenkins-hbase4.apache.org,34493,1689185653159)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689185684263.8ef0a6ec9ddd6385dcf8b8375acd8d8f. 2023-07-12 18:14:45,432 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 18:14:45,432 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 18:14:45,432 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:14:45,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 18:14:45,432 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-12 18:14:45,432 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,34493,1689185653159' in zk 2023-07-12 18:14:45,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-12 18:14:45,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:14:45,433 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-12 18:14:45,433 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 18:14:45,434 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-12 18:14:45,435 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:14:45,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:14:45,435 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-12 18:14:45,436 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 18:14:45,436 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-12 18:14:45,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:14:45,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 18:14:45,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-12 18:14:45,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:14:45,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:14:45,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:14:45,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,34205,1689185653087': 2023-07-12 18:14:45,439 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34205,1689185653087' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-12 18:14:45,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:14:45,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 18:14:45,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 18:14:45,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 18:14:45,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 18:14:45,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-12 18:14:45,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:14:45,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:14:45,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:14:45,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 18:14:45,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-12 18:14:45,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:14:45,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:14:45,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:14:45,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,34493,1689185653159': 2023-07-12 18:14:45,449 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34493,1689185653159' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-12 18:14:45,449 INFO [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-07-12 18:14:45,449 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 18:14:45,449 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 18:14:45,449 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-07-12 18:14:45,449 INFO [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 18:14:45,451 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 18:14:45,451 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 18:14:45,451 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:14:45,451 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 18:14:45,451 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 18:14:45,451 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 18:14:45,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 18:14:45,451 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:14:45,451 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 18:14:45,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 18:14:45,451 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:14:45,451 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 18:14:45,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 18:14:45,452 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:14:45,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 18:14:45,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 18:14:45,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 18:14:45,452 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:14:45,452 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:14:45,452 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:14:45,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:14:45,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:14:45,452 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:14:45,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:14:45,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 18:14:45,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 18:14:45,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 18:14:45,453 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:14:45,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 18:14:45,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-12 18:14:45,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 18:14:45,456 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:14:45,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-12 18:14:45,456 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:14:45,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:14:45,456 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:14:45,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:14:45,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:14:45,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 18:14:45,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-12 18:14:45,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:14:45,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:14:45,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:14:45,467 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:14:45,467 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-12 18:14:45,467 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:14:45,467 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:14:45,467 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:14:45,467 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:14:45,468 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:14:45,468 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:14:45,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:14:45,467 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:14:45,468 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 18:14:45,467 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:14:45,470 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:14:45,470 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:14:45,467 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-12 18:14:45,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:14:45,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:14:45,470 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:14:45,468 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-07-12 18:14:45,470 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState because node does not exist (not an error) 2023-07-12 18:14:45,470 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:14:45,470 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 18:14:45,470 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:14:45,470 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-07-12 18:14:45,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:14:45,471 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:14:45,471 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-12 18:14:45,470 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:14:45,471 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-12 18:14:45,471 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:14:45,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:14:45,471 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 18:14:45,471 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 18:14:45,472 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202307123f186a39230749ad82762180327a2a28, hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202307128f521c0b1f7942a283ea9d74813cbe80] mob files 2023-07-12 18:14:45,472 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202307123f186a39230749ad82762180327a2a28 2023-07-12 18:14:45,472 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202307128f521c0b1f7942a283ea9d74813cbe80 2023-07-12 18:14:45,472 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:14:45,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:14:45,488 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-07-12 18:14:45,489 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-12 18:14:45,518 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-12 18:14:45,570 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-12 18:14:45,570 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-12 18:14:45,570 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-12 18:14:45,571 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689185685301Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1689185685488 (+187 ms)Consolidate snapshot: snaptb0-testExportFileSystemState at 1689185685488Loading Region manifests for snaptb0-testExportFileSystemState at 1689185685489 (+1 ms)Writing data manifest for snaptb0-testExportFileSystemState at 1689185685493 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1689185685504 (+11 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689185685570 (+66 ms) 2023-07-12 18:14:45,574 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-12 18:14:45,576 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 272 msec 2023-07-12 18:14:45,605 DEBUG [Listener at jenkins-hbase4.apache.org/41393] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 18:14:45,606 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-12 18:14:45,606 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 18:14:45,607 INFO [Listener at jenkins-hbase4.apache.org/41393] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/export-test/export-1689185685607 2023-07-12 18:14:45,607 INFO [Listener at jenkins-hbase4.apache.org/41393] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:38679, tgtDir=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/export-test/export-1689185685607, rawTgtDir=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/export-test/export-1689185685607, srcFsUri=hdfs://localhost:38679, srcDir=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0 2023-07-12 18:14:45,641 DEBUG [Listener at jenkins-hbase4.apache.org/41393] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:38679, inputRoot=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0 2023-07-12 18:14:45,641 DEBUG [Listener at jenkins-hbase4.apache.org/41393] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1401111384_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/export-test/export-1689185685607, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/export-test/export-1689185685607/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-12 18:14:45,641 INFO [Listener at jenkins-hbase4.apache.org/41393] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:38679, inputRoot=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0, snapshotDir=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-07-12 18:14:45,673 INFO [Listener at jenkins-hbase4.apache.org/41393] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/export-test/export-1689185685607/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-12 18:14:46,118 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-12 18:14:46,118 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-12 18:14:46,119 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-12 18:14:46,119 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-12 18:14:47,143 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/908563f7-ecc5-f8cf-2e08-f8e1a8353ad0/hadoop-3889480895124277940.jar 2023-07-12 18:14:47,144 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-12 18:14:47,144 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-12 18:14:47,227 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/908563f7-ecc5-f8cf-2e08-f8e1a8353ad0/hadoop-9037106974144861094.jar 2023-07-12 18:14:47,228 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-12 18:14:47,229 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-12 18:14:47,229 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-12 18:14:47,230 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-12 18:14:47,230 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-12 18:14:47,231 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-12 18:14:47,231 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-12 18:14:47,232 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-12 18:14:47,232 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-12 18:14:47,233 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-12 18:14:47,234 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-12 18:14:47,234 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-12 18:14:47,235 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-12 18:14:47,235 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-12 18:14:47,236 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-12 18:14:47,237 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-12 18:14:47,238 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 18:14:47,238 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 18:14:47,239 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 18:14:47,240 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 18:14:47,240 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 18:14:47,241 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 18:14:47,242 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 18:14:47,777 WARN [Listener at jenkins-hbase4.apache.org/41393] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-12 18:14:47,780 INFO [Listener at jenkins-hbase4.apache.org/41393] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-07-12 18:14:47,783 DEBUG [Listener at jenkins-hbase4.apache.org/41393] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-07-12 18:14:47,940 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 18:14:47,940 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 18:14:47,948 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689185662417_0001_000001 (auth:SIMPLE) 2023-07-12 18:14:48,811 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689185662417_0002_000001 (auth:SIMPLE) 2023-07-12 18:14:49,389 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-12 18:14:53,837 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689185662417_0002_000001 (auth:SIMPLE) 2023-07-12 18:14:56,084 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689185662417_0002_000001 (auth:SIMPLE) 2023-07-12 18:14:59,720 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689185662417_0002_000001 (auth:SIMPLE) 2023-07-12 18:15:01,069 INFO [Listener at jenkins-hbase4.apache.org/41393] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-12 18:15:01,072 INFO [Listener at jenkins-hbase4.apache.org/41393] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-12 18:15:01,084 INFO [Listener at jenkins-hbase4.apache.org/41393] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-07-12 18:15:01,085 INFO [Listener at jenkins-hbase4.apache.org/41393] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-12 18:15:01,085 INFO [Listener at jenkins-hbase4.apache.org/41393] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-12 18:15:01,086 DEBUG [Listener at jenkins-hbase4.apache.org/41393] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-639947816_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-12 18:15:01,086 DEBUG [Listener at jenkins-hbase4.apache.org/41393] snapshot.TestExportSnapshot(367): hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-12 18:15:01,086 DEBUG [Listener at jenkins-hbase4.apache.org/41393] snapshot.TestExportSnapshot(367): hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-12 18:15:01,086 DEBUG [Listener at jenkins-hbase4.apache.org/41393] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-639947816_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/export-test/export-1689185685607/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/export-test/export-1689185685607/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-12 18:15:01,087 DEBUG [Listener at jenkins-hbase4.apache.org/41393] snapshot.TestExportSnapshot(367): hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/export-test/export-1689185685607/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-12 18:15:01,087 DEBUG [Listener at jenkins-hbase4.apache.org/41393] snapshot.TestExportSnapshot(367): hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/export-test/export-1689185685607/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-12 18:15:01,097 INFO [Listener at jenkins-hbase4.apache.org/41393] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-07-12 18:15:01,098 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-07-12 18:15:01,099 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] procedure2.ProcedureExecutor(1029): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-07-12 18:15:01,105 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-12 18:15:01,105 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689185701105"}]},"ts":"1689185701105"} 2023-07-12 18:15:01,107 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-07-12 18:15:01,109 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-07-12 18:15:01,111 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=3b0286c8f5bd597207713cb344c8a57f, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=8ef0a6ec9ddd6385dcf8b8375acd8d8f, UNASSIGN}] 2023-07-12 18:15:01,114 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=3b0286c8f5bd597207713cb344c8a57f, UNASSIGN 2023-07-12 18:15:01,114 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=8ef0a6ec9ddd6385dcf8b8375acd8d8f, UNASSIGN 2023-07-12 18:15:01,115 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=3b0286c8f5bd597207713cb344c8a57f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:15:01,115 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=8ef0a6ec9ddd6385dcf8b8375acd8d8f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:15:01,115 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689185684263.3b0286c8f5bd597207713cb344c8a57f.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689185701115"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689185701115"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689185701115"}]},"ts":"1689185701115"} 2023-07-12 18:15:01,115 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689185684263.8ef0a6ec9ddd6385dcf8b8375acd8d8f.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689185701115"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689185701115"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689185701115"}]},"ts":"1689185701115"} 2023-07-12 18:15:01,117 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=39, ppid=37, state=RUNNABLE; CloseRegionProcedure 3b0286c8f5bd597207713cb344c8a57f, server=jenkins-hbase4.apache.org,34205,1689185653087}] 2023-07-12 18:15:01,118 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=38, state=RUNNABLE; CloseRegionProcedure 8ef0a6ec9ddd6385dcf8b8375acd8d8f, server=jenkins-hbase4.apache.org,34493,1689185653159}] 2023-07-12 18:15:01,216 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-12 18:15:01,271 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 3b0286c8f5bd597207713cb344c8a57f 2023-07-12 18:15:01,271 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 3b0286c8f5bd597207713cb344c8a57f, disabling compactions & flushes 2023-07-12 18:15:01,271 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689185684263.3b0286c8f5bd597207713cb344c8a57f. 2023-07-12 18:15:01,271 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689185684263.3b0286c8f5bd597207713cb344c8a57f. 2023-07-12 18:15:01,271 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689185684263.3b0286c8f5bd597207713cb344c8a57f. after waiting 0 ms 2023-07-12 18:15:01,271 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689185684263.3b0286c8f5bd597207713cb344c8a57f. 2023-07-12 18:15:01,276 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 8ef0a6ec9ddd6385dcf8b8375acd8d8f 2023-07-12 18:15:01,277 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 8ef0a6ec9ddd6385dcf8b8375acd8d8f, disabling compactions & flushes 2023-07-12 18:15:01,277 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689185684263.8ef0a6ec9ddd6385dcf8b8375acd8d8f. 2023-07-12 18:15:01,277 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689185684263.8ef0a6ec9ddd6385dcf8b8375acd8d8f. 2023-07-12 18:15:01,277 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689185684263.8ef0a6ec9ddd6385dcf8b8375acd8d8f. after waiting 0 ms 2023-07-12 18:15:01,277 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689185684263.8ef0a6ec9ddd6385dcf8b8375acd8d8f. 2023-07-12 18:15:01,290 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testExportFileSystemState/3b0286c8f5bd597207713cb344c8a57f/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 18:15:01,290 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testExportFileSystemState/8ef0a6ec9ddd6385dcf8b8375acd8d8f/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 18:15:01,291 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 18:15:01,291 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 18:15:01,292 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689185684263.3b0286c8f5bd597207713cb344c8a57f. 2023-07-12 18:15:01,293 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689185684263.8ef0a6ec9ddd6385dcf8b8375acd8d8f. 2023-07-12 18:15:01,293 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 3b0286c8f5bd597207713cb344c8a57f: 2023-07-12 18:15:01,293 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 8ef0a6ec9ddd6385dcf8b8375acd8d8f: 2023-07-12 18:15:01,299 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 8ef0a6ec9ddd6385dcf8b8375acd8d8f 2023-07-12 18:15:01,300 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=8ef0a6ec9ddd6385dcf8b8375acd8d8f, regionState=CLOSED 2023-07-12 18:15:01,300 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 3b0286c8f5bd597207713cb344c8a57f 2023-07-12 18:15:01,300 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689185684263.8ef0a6ec9ddd6385dcf8b8375acd8d8f.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689185701300"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689185701300"}]},"ts":"1689185701300"} 2023-07-12 18:15:01,301 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=3b0286c8f5bd597207713cb344c8a57f, regionState=CLOSED 2023-07-12 18:15:01,301 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689185684263.3b0286c8f5bd597207713cb344c8a57f.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689185701301"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689185701301"}]},"ts":"1689185701301"} 2023-07-12 18:15:01,307 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=38 2023-07-12 18:15:01,307 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=38, state=SUCCESS; CloseRegionProcedure 8ef0a6ec9ddd6385dcf8b8375acd8d8f, server=jenkins-hbase4.apache.org,34493,1689185653159 in 184 msec 2023-07-12 18:15:01,308 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=39, resume processing ppid=37 2023-07-12 18:15:01,308 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=37, state=SUCCESS; CloseRegionProcedure 3b0286c8f5bd597207713cb344c8a57f, server=jenkins-hbase4.apache.org,34205,1689185653087 in 187 msec 2023-07-12 18:15:01,309 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=8ef0a6ec9ddd6385dcf8b8375acd8d8f, UNASSIGN in 196 msec 2023-07-12 18:15:01,312 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=37, resume processing ppid=36 2023-07-12 18:15:01,312 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=3b0286c8f5bd597207713cb344c8a57f, UNASSIGN in 197 msec 2023-07-12 18:15:01,313 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689185701313"}]},"ts":"1689185701313"} 2023-07-12 18:15:01,315 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-07-12 18:15:01,317 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-07-12 18:15:01,320 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 220 msec 2023-07-12 18:15:01,417 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-12 18:15:01,417 INFO [Listener at jenkins-hbase4.apache.org/41393] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-07-12 18:15:01,418 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-07-12 18:15:01,419 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] procedure2.ProcedureExecutor(1029): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-12 18:15:01,422 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-12 18:15:01,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-07-12 18:15:01,423 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-12 18:15:01,424 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34493] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-07-12 18:15:01,428 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testExportFileSystemState/3b0286c8f5bd597207713cb344c8a57f 2023-07-12 18:15:01,428 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testExportFileSystemState/8ef0a6ec9ddd6385dcf8b8375acd8d8f 2023-07-12 18:15:01,428 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-12 18:15:01,428 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-12 18:15:01,428 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-12 18:15:01,429 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-12 18:15:01,429 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-12 18:15:01,429 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-12 18:15:01,429 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-12 18:15:01,429 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-12 18:15:01,430 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-12 18:15:01,430 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-12 18:15:01,430 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 18:15:01,430 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-12 18:15:01,430 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testExportFileSystemState/3b0286c8f5bd597207713cb344c8a57f/cf, FileablePath, hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testExportFileSystemState/3b0286c8f5bd597207713cb344c8a57f/recovered.edits] 2023-07-12 18:15:01,431 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-12 18:15:01,430 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 18:15:01,431 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 18:15:01,430 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 18:15:01,431 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testExportFileSystemState/8ef0a6ec9ddd6385dcf8b8375acd8d8f/cf, FileablePath, hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testExportFileSystemState/8ef0a6ec9ddd6385dcf8b8375acd8d8f/recovered.edits] 2023-07-12 18:15:01,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-12 18:15:01,436 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testExportFileSystemState/3b0286c8f5bd597207713cb344c8a57f/cf/8f1701bda51441608040e868a91fe29b to hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/archive/data/default/testtb-testExportFileSystemState/3b0286c8f5bd597207713cb344c8a57f/cf/8f1701bda51441608040e868a91fe29b 2023-07-12 18:15:01,436 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testExportFileSystemState/8ef0a6ec9ddd6385dcf8b8375acd8d8f/cf/866712a48ad742d9b9948fd79560fc63 to hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/archive/data/default/testtb-testExportFileSystemState/8ef0a6ec9ddd6385dcf8b8375acd8d8f/cf/866712a48ad742d9b9948fd79560fc63 2023-07-12 18:15:01,440 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testExportFileSystemState/3b0286c8f5bd597207713cb344c8a57f/recovered.edits/9.seqid to hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/archive/data/default/testtb-testExportFileSystemState/3b0286c8f5bd597207713cb344c8a57f/recovered.edits/9.seqid 2023-07-12 18:15:01,440 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testExportFileSystemState/8ef0a6ec9ddd6385dcf8b8375acd8d8f/recovered.edits/9.seqid to hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/archive/data/default/testtb-testExportFileSystemState/8ef0a6ec9ddd6385dcf8b8375acd8d8f/recovered.edits/9.seqid 2023-07-12 18:15:01,441 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testExportFileSystemState/3b0286c8f5bd597207713cb344c8a57f 2023-07-12 18:15:01,441 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testExportFileSystemState/8ef0a6ec9ddd6385dcf8b8375acd8d8f 2023-07-12 18:15:01,441 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-12 18:15:01,441 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-07-12 18:15:01,442 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf] 2023-07-12 18:15:01,446 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202307123f186a39230749ad82762180327a2a28 to hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202307123f186a39230749ad82762180327a2a28 2023-07-12 18:15:01,448 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202307128f521c0b1f7942a283ea9d74813cbe80 to hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202307128f521c0b1f7942a283ea9d74813cbe80 2023-07-12 18:15:01,448 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-07-12 18:15:01,451 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-12 18:15:01,454 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-07-12 18:15:01,456 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-07-12 18:15:01,457 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-12 18:15:01,457 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-07-12 18:15:01,457 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1689185684263.3b0286c8f5bd597207713cb344c8a57f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689185701457"}]},"ts":"9223372036854775807"} 2023-07-12 18:15:01,457 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1689185684263.8ef0a6ec9ddd6385dcf8b8375acd8d8f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689185701457"}]},"ts":"9223372036854775807"} 2023-07-12 18:15:01,459 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-12 18:15:01,459 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 3b0286c8f5bd597207713cb344c8a57f, NAME => 'testtb-testExportFileSystemState,,1689185684263.3b0286c8f5bd597207713cb344c8a57f.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 8ef0a6ec9ddd6385dcf8b8375acd8d8f, NAME => 'testtb-testExportFileSystemState,1,1689185684263.8ef0a6ec9ddd6385dcf8b8375acd8d8f.', STARTKEY => '1', ENDKEY => ''}] 2023-07-12 18:15:01,459 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-07-12 18:15:01,459 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689185701459"}]},"ts":"9223372036854775807"} 2023-07-12 18:15:01,461 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-07-12 18:15:01,463 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-12 18:15:01,465 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 45 msec 2023-07-12 18:15:01,533 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-12 18:15:01,533 INFO [Listener at jenkins-hbase4.apache.org/41393] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-07-12 18:15:01,541 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-07-12 18:15:01,543 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-07-12 18:15:01,545 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-07-12 18:15:01,547 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-07-12 18:15:01,573 INFO [Listener at jenkins-hbase4.apache.org/41393] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=761 (was 752) Potentially hanging thread: IPC Client (1506713691) connection to jenkins-hbase4.apache.org/172.31.14.131:34003 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (1506713691) connection to jenkins-hbase4.apache.org/172.31.14.131:34637 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x30e4ce87-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1773475379_17 at /127.0.0.1:56624 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-639947816_17 at /127.0.0.1:57632 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x30e4ce87-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-2029 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-35650011_1 at /127.0.0.1:36240 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x30e4ce87-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-639947816_17 at /127.0.0.1:39000 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x30e4ce87-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=929 (was 917) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=324 (was 371), ProcessCount=179 (was 179), AvailableMemoryMB=4935 (was 5213) 2023-07-12 18:15:01,573 WARN [Listener at jenkins-hbase4.apache.org/41393] hbase.ResourceChecker(130): Thread=761 is superior to 500 2023-07-12 18:15:01,597 INFO [Listener at jenkins-hbase4.apache.org/41393] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=761, OpenFileDescriptor=929, MaxFileDescriptor=60000, SystemLoadAverage=324, ProcessCount=179, AvailableMemoryMB=4934 2023-07-12 18:15:01,597 WARN [Listener at jenkins-hbase4.apache.org/41393] hbase.ResourceChecker(130): Thread=761 is superior to 500 2023-07-12 18:15:01,599 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-12 18:15:01,600 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-07-12 18:15:01,603 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 18:15:01,603 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-07-12 18:15:01,604 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 18:15:01,604 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-12 18:15:01,607 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testConsecutiveExports/41d630f90edbdddf39cd8185ce69835e 2023-07-12 18:15:01,607 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testConsecutiveExports/ada568dc01c4278607317f7284319ab7 2023-07-12 18:15:01,607 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testConsecutiveExports/41d630f90edbdddf39cd8185ce69835e empty. 2023-07-12 18:15:01,607 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testConsecutiveExports/ada568dc01c4278607317f7284319ab7 empty. 2023-07-12 18:15:01,608 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testConsecutiveExports/41d630f90edbdddf39cd8185ce69835e 2023-07-12 18:15:01,608 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testConsecutiveExports/ada568dc01c4278607317f7284319ab7 2023-07-12 18:15:01,608 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-12 18:15:01,618 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-07-12 18:15:01,619 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => 41d630f90edbdddf39cd8185ce69835e, NAME => 'testtb-testConsecutiveExports,,1689185701599.41d630f90edbdddf39cd8185ce69835e.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp 2023-07-12 18:15:01,619 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => ada568dc01c4278607317f7284319ab7, NAME => 'testtb-testConsecutiveExports,1,1689185701599.ada568dc01c4278607317f7284319ab7.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp 2023-07-12 18:15:01,645 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689185701599.41d630f90edbdddf39cd8185ce69835e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 18:15:01,645 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing 41d630f90edbdddf39cd8185ce69835e, disabling compactions & flushes 2023-07-12 18:15:01,645 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689185701599.41d630f90edbdddf39cd8185ce69835e. 2023-07-12 18:15:01,645 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689185701599.41d630f90edbdddf39cd8185ce69835e. 2023-07-12 18:15:01,645 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689185701599.41d630f90edbdddf39cd8185ce69835e. after waiting 0 ms 2023-07-12 18:15:01,645 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689185701599.41d630f90edbdddf39cd8185ce69835e. 2023-07-12 18:15:01,645 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689185701599.41d630f90edbdddf39cd8185ce69835e. 2023-07-12 18:15:01,645 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for 41d630f90edbdddf39cd8185ce69835e: 2023-07-12 18:15:01,646 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689185701599.ada568dc01c4278607317f7284319ab7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 18:15:01,646 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing ada568dc01c4278607317f7284319ab7, disabling compactions & flushes 2023-07-12 18:15:01,646 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689185701599.ada568dc01c4278607317f7284319ab7. 2023-07-12 18:15:01,646 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689185701599.ada568dc01c4278607317f7284319ab7. 2023-07-12 18:15:01,646 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689185701599.ada568dc01c4278607317f7284319ab7. after waiting 0 ms 2023-07-12 18:15:01,646 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689185701599.ada568dc01c4278607317f7284319ab7. 2023-07-12 18:15:01,646 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689185701599.ada568dc01c4278607317f7284319ab7. 2023-07-12 18:15:01,646 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for ada568dc01c4278607317f7284319ab7: 2023-07-12 18:15:01,649 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 18:15:01,649 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689185701599.41d630f90edbdddf39cd8185ce69835e.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689185701649"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689185701649"}]},"ts":"1689185701649"} 2023-07-12 18:15:01,650 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689185701599.ada568dc01c4278607317f7284319ab7.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689185701649"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689185701649"}]},"ts":"1689185701649"} 2023-07-12 18:15:01,652 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-12 18:15:01,653 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 18:15:01,653 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689185701653"}]},"ts":"1689185701653"} 2023-07-12 18:15:01,654 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-07-12 18:15:01,658 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-12 18:15:01,659 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 18:15:01,659 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 18:15:01,659 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-12 18:15:01,659 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 18:15:01,660 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=41d630f90edbdddf39cd8185ce69835e, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ada568dc01c4278607317f7284319ab7, ASSIGN}] 2023-07-12 18:15:01,662 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ada568dc01c4278607317f7284319ab7, ASSIGN 2023-07-12 18:15:01,662 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=41d630f90edbdddf39cd8185ce69835e, ASSIGN 2023-07-12 18:15:01,663 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=41d630f90edbdddf39cd8185ce69835e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37689,1689185653014; forceNewPlan=false, retain=false 2023-07-12 18:15:01,663 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ada568dc01c4278607317f7284319ab7, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34205,1689185653087; forceNewPlan=false, retain=false 2023-07-12 18:15:01,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-12 18:15:01,814 INFO [jenkins-hbase4:43177] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-12 18:15:01,816 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=41d630f90edbdddf39cd8185ce69835e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:15:01,816 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=ada568dc01c4278607317f7284319ab7, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:15:01,817 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689185701599.41d630f90edbdddf39cd8185ce69835e.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689185701816"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689185701816"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689185701816"}]},"ts":"1689185701816"} 2023-07-12 18:15:01,817 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689185701599.ada568dc01c4278607317f7284319ab7.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689185701816"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689185701816"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689185701816"}]},"ts":"1689185701816"} 2023-07-12 18:15:01,819 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=43, state=RUNNABLE; OpenRegionProcedure 41d630f90edbdddf39cd8185ce69835e, server=jenkins-hbase4.apache.org,37689,1689185653014}] 2023-07-12 18:15:01,819 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=44, state=RUNNABLE; OpenRegionProcedure ada568dc01c4278607317f7284319ab7, server=jenkins-hbase4.apache.org,34205,1689185653087}] 2023-07-12 18:15:01,907 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-12 18:15:01,978 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1689185701599.ada568dc01c4278607317f7284319ab7. 2023-07-12 18:15:01,978 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ada568dc01c4278607317f7284319ab7, NAME => 'testtb-testConsecutiveExports,1,1689185701599.ada568dc01c4278607317f7284319ab7.', STARTKEY => '1', ENDKEY => ''} 2023-07-12 18:15:01,979 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1689185701599.ada568dc01c4278607317f7284319ab7. service=AccessControlService 2023-07-12 18:15:01,979 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1689185701599.41d630f90edbdddf39cd8185ce69835e. 2023-07-12 18:15:01,979 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 41d630f90edbdddf39cd8185ce69835e, NAME => 'testtb-testConsecutiveExports,,1689185701599.41d630f90edbdddf39cd8185ce69835e.', STARTKEY => '', ENDKEY => '1'} 2023-07-12 18:15:01,979 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 18:15:01,979 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports ada568dc01c4278607317f7284319ab7 2023-07-12 18:15:01,979 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1689185701599.41d630f90edbdddf39cd8185ce69835e. service=AccessControlService 2023-07-12 18:15:01,979 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689185701599.ada568dc01c4278607317f7284319ab7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 18:15:01,979 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ada568dc01c4278607317f7284319ab7 2023-07-12 18:15:01,979 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 18:15:01,979 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ada568dc01c4278607317f7284319ab7 2023-07-12 18:15:01,980 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 41d630f90edbdddf39cd8185ce69835e 2023-07-12 18:15:01,980 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689185701599.41d630f90edbdddf39cd8185ce69835e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 18:15:01,980 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 41d630f90edbdddf39cd8185ce69835e 2023-07-12 18:15:01,980 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 41d630f90edbdddf39cd8185ce69835e 2023-07-12 18:15:01,985 INFO [StoreOpener-ada568dc01c4278607317f7284319ab7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region ada568dc01c4278607317f7284319ab7 2023-07-12 18:15:01,985 INFO [StoreOpener-41d630f90edbdddf39cd8185ce69835e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 41d630f90edbdddf39cd8185ce69835e 2023-07-12 18:15:01,987 DEBUG [StoreOpener-ada568dc01c4278607317f7284319ab7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testConsecutiveExports/ada568dc01c4278607317f7284319ab7/cf 2023-07-12 18:15:01,987 DEBUG [StoreOpener-41d630f90edbdddf39cd8185ce69835e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testConsecutiveExports/41d630f90edbdddf39cd8185ce69835e/cf 2023-07-12 18:15:01,987 DEBUG [StoreOpener-41d630f90edbdddf39cd8185ce69835e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testConsecutiveExports/41d630f90edbdddf39cd8185ce69835e/cf 2023-07-12 18:15:01,987 DEBUG [StoreOpener-ada568dc01c4278607317f7284319ab7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testConsecutiveExports/ada568dc01c4278607317f7284319ab7/cf 2023-07-12 18:15:01,988 INFO [StoreOpener-ada568dc01c4278607317f7284319ab7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ada568dc01c4278607317f7284319ab7 columnFamilyName cf 2023-07-12 18:15:01,988 INFO [StoreOpener-41d630f90edbdddf39cd8185ce69835e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 41d630f90edbdddf39cd8185ce69835e columnFamilyName cf 2023-07-12 18:15:01,989 INFO [StoreOpener-ada568dc01c4278607317f7284319ab7-1] regionserver.HStore(310): Store=ada568dc01c4278607317f7284319ab7/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 18:15:01,989 INFO [StoreOpener-41d630f90edbdddf39cd8185ce69835e-1] regionserver.HStore(310): Store=41d630f90edbdddf39cd8185ce69835e/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 18:15:01,990 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testConsecutiveExports/ada568dc01c4278607317f7284319ab7 2023-07-12 18:15:01,990 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testConsecutiveExports/41d630f90edbdddf39cd8185ce69835e 2023-07-12 18:15:01,990 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testConsecutiveExports/ada568dc01c4278607317f7284319ab7 2023-07-12 18:15:01,991 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testConsecutiveExports/41d630f90edbdddf39cd8185ce69835e 2023-07-12 18:15:01,993 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ada568dc01c4278607317f7284319ab7 2023-07-12 18:15:01,993 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 41d630f90edbdddf39cd8185ce69835e 2023-07-12 18:15:01,995 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testConsecutiveExports/ada568dc01c4278607317f7284319ab7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 18:15:01,995 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testConsecutiveExports/41d630f90edbdddf39cd8185ce69835e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 18:15:01,996 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 41d630f90edbdddf39cd8185ce69835e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68498204, jitterRate=0.020702779293060303}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 18:15:01,996 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ada568dc01c4278607317f7284319ab7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67427482, jitterRate=0.0047477781772613525}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 18:15:01,996 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 41d630f90edbdddf39cd8185ce69835e: 2023-07-12 18:15:01,996 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ada568dc01c4278607317f7284319ab7: 2023-07-12 18:15:01,997 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1689185701599.41d630f90edbdddf39cd8185ce69835e., pid=45, masterSystemTime=1689185701971 2023-07-12 18:15:01,997 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1689185701599.ada568dc01c4278607317f7284319ab7., pid=46, masterSystemTime=1689185701971 2023-07-12 18:15:01,998 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1689185701599.41d630f90edbdddf39cd8185ce69835e. 2023-07-12 18:15:01,998 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1689185701599.41d630f90edbdddf39cd8185ce69835e. 2023-07-12 18:15:01,999 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=41d630f90edbdddf39cd8185ce69835e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:15:01,999 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1689185701599.ada568dc01c4278607317f7284319ab7. 2023-07-12 18:15:01,999 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1689185701599.ada568dc01c4278607317f7284319ab7. 2023-07-12 18:15:01,999 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1689185701599.41d630f90edbdddf39cd8185ce69835e.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689185701999"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689185701999"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689185701999"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689185701999"}]},"ts":"1689185701999"} 2023-07-12 18:15:02,000 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=ada568dc01c4278607317f7284319ab7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:15:02,000 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1689185701599.ada568dc01c4278607317f7284319ab7.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689185702000"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689185702000"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689185702000"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689185702000"}]},"ts":"1689185702000"} 2023-07-12 18:15:02,005 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=43 2023-07-12 18:15:02,005 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=43, state=SUCCESS; OpenRegionProcedure 41d630f90edbdddf39cd8185ce69835e, server=jenkins-hbase4.apache.org,37689,1689185653014 in 182 msec 2023-07-12 18:15:02,006 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=44 2023-07-12 18:15:02,006 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=44, state=SUCCESS; OpenRegionProcedure ada568dc01c4278607317f7284319ab7, server=jenkins-hbase4.apache.org,34205,1689185653087 in 184 msec 2023-07-12 18:15:02,007 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=41d630f90edbdddf39cd8185ce69835e, ASSIGN in 345 msec 2023-07-12 18:15:02,008 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=42 2023-07-12 18:15:02,008 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ada568dc01c4278607317f7284319ab7, ASSIGN in 346 msec 2023-07-12 18:15:02,009 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 18:15:02,009 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689185702009"}]},"ts":"1689185702009"} 2023-07-12 18:15:02,011 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-07-12 18:15:02,013 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 18:15:02,014 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-07-12 18:15:02,016 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34493] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-12 18:15:02,018 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 18:15:02,018 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 18:15:02,018 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 18:15:02,018 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 18:15:02,021 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-12 18:15:02,021 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-12 18:15:02,021 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-12 18:15:02,022 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-12 18:15:02,023 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 422 msec 2023-07-12 18:15:02,208 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-12 18:15:02,209 INFO [Listener at jenkins-hbase4.apache.org/41393] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-07-12 18:15:02,211 DEBUG [Listener at jenkins-hbase4.apache.org/41393] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-12 18:15:02,211 DEBUG [Listener at jenkins-hbase4.apache.org/41393] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1689185701599.41d630f90edbdddf39cd8185ce69835e. 2023-07-12 18:15:02,214 INFO [Listener at jenkins-hbase4.apache.org/41393] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 18:15:02,229 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-12 18:15:02,229 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689185702229 (current time:1689185702229). 2023-07-12 18:15:02,229 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 18:15:02,229 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] zookeeper.ReadOnlyZKClient(139): Connect 0x2f9a7f40 to 127.0.0.1:62122 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 18:15:02,237 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6887d66d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 18:15:02,240 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 18:15:02,243 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39834, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 18:15:02,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2f9a7f40 to 127.0.0.1:62122 2023-07-12 18:15:02,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 18:15:02,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] zookeeper.ReadOnlyZKClient(139): Connect 0x664b98ab to 127.0.0.1:62122 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 18:15:02,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1a578b5d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 18:15:02,267 DEBUG [hconnection-0x4cb502c4-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 18:15:02,269 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39838, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 18:15:02,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x664b98ab to 127.0.0.1:62122 2023-07-12 18:15:02,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 18:15:02,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-12 18:15:02,277 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 18:15:02,277 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-12 18:15:02,279 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] procedure2.ProcedureExecutor(1029): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-12 18:15:02,281 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-12 18:15:02,282 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689186302282 2023-07-12 18:15:02,282 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-12 18:15:02,282 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-12 18:15:02,282 DEBUG [Listener at jenkins-hbase4.apache.org/41393] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 18:15:02,283 DEBUG [Listener at jenkins-hbase4.apache.org/41393] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 18:15:02,284 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-12 18:15:02,284 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-12 18:15:02,286 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 7 msec 2023-07-12 18:15:02,286 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-12 18:15:02,287 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689186302287 2023-07-12 18:15:02,304 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:02,304 INFO [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-07-12 18:15:02,305 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 18:15:02,306 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-07-12 18:15:02,306 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-12 18:15:02,307 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:02,307 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:02,308 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:15:02,308 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:15:02,308 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:15:02,308 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:15:02,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:15:02,308 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:15:02,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:15:02,308 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:15:02,309 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:15:02,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:15:02,309 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:15:02,309 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:15:02,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:02,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:02,309 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:15:02,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:02,309 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 18:15:02,310 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:02,310 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:02,310 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:02,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-12 18:15:02,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:02,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-12 18:15:02,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:02,310 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-12 18:15:02,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-12 18:15:02,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:02,311 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-12 18:15:02,311 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-12 18:15:02,311 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:02,311 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-12 18:15:02,311 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 18:15:02,312 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:02,312 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:02,312 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-12 18:15:02,312 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 18:15:02,312 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-12 18:15:02,312 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 18:15:02,324 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-12 18:15:02,324 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-12 18:15:02,324 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34205,1689185653087' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-12 18:15:02,324 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-12 18:15:02,324 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-12 18:15:02,324 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-12 18:15:02,324 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-12 18:15:02,324 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34493,1689185653159' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-12 18:15:02,324 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37689,1689185653014' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-12 18:15:02,326 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:15:02,327 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:02,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:15:02,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 18:15:02,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 18:15:02,327 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:15:02,327 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:02,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 18:15:02,327 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:02,327 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 18:15:02,327 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:02,328 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:02,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 18:15:02,328 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 18:15:02,328 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:02,328 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 18:15:02,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:02,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:15:02,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:15:02,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:15:02,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 18:15:02,330 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34205,1689185653087' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-12 18:15:02,330 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1700d4d2[Count = 1] remaining members to acquire global barrier 2023-07-12 18:15:02,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:15:02,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 18:15:02,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 18:15:02,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 18:15:02,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 18:15:02,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:02,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:15:02,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:15:02,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:15:02,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 18:15:02,333 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37689,1689185653014' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-12 18:15:02,333 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1700d4d2[Count = 0] remaining members to acquire global barrier 2023-07-12 18:15:02,333 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-12 18:15:02,333 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:02,336 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:02,336 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:02,336 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:02,336 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:02,336 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:02,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:02,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:02,336 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-12 18:15:02,336 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:15:02,336 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-12 18:15:02,336 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-12 18:15:02,336 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:02,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:02,336 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,34493,1689185653159' in zk 2023-07-12 18:15:02,337 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-12 18:15:02,337 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:15:02,337 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 18:15:02,337 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 18:15:02,337 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 18:15:02,337 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 18:15:02,337 DEBUG [rs(jenkins-hbase4.apache.org,37689,1689185653014)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689185701599.41d630f90edbdddf39cd8185ce69835e. 2023-07-12 18:15:02,337 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 18:15:02,337 DEBUG [rs(jenkins-hbase4.apache.org,37689,1689185653014)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689185701599.41d630f90edbdddf39cd8185ce69835e. started... 2023-07-12 18:15:02,337 DEBUG [rs(jenkins-hbase4.apache.org,34205,1689185653087)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689185701599.ada568dc01c4278607317f7284319ab7. 2023-07-12 18:15:02,337 DEBUG [rs(jenkins-hbase4.apache.org,34205,1689185653087)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689185701599.ada568dc01c4278607317f7284319ab7. started... 2023-07-12 18:15:02,339 DEBUG [rs(jenkins-hbase4.apache.org,34205,1689185653087)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ada568dc01c4278607317f7284319ab7: 2023-07-12 18:15:02,339 DEBUG [rs(jenkins-hbase4.apache.org,37689,1689185653014)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 41d630f90edbdddf39cd8185ce69835e: 2023-07-12 18:15:02,339 DEBUG [rs(jenkins-hbase4.apache.org,34205,1689185653087)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689185701599.ada568dc01c4278607317f7284319ab7.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:02,339 DEBUG [rs(jenkins-hbase4.apache.org,37689,1689185653014)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689185701599.41d630f90edbdddf39cd8185ce69835e.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:02,339 DEBUG [rs(jenkins-hbase4.apache.org,34205,1689185653087)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 18:15:02,339 DEBUG [rs(jenkins-hbase4.apache.org,37689,1689185653014)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 18:15:02,339 DEBUG [rs(jenkins-hbase4.apache.org,34205,1689185653087)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 18:15:02,339 DEBUG [rs(jenkins-hbase4.apache.org,37689,1689185653014)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 18:15:02,342 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-12 18:15:02,342 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 18:15:02,342 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-12 18:15:02,383 DEBUG [Listener at jenkins-hbase4.apache.org/41393] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 18:15:02,385 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-12 18:15:02,385 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-12 18:15:02,386 DEBUG [Listener at jenkins-hbase4.apache.org/41393] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 18:15:02,394 DEBUG [rs(jenkins-hbase4.apache.org,34205,1689185653087)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689185701599.ada568dc01c4278607317f7284319ab7. completed. 2023-07-12 18:15:02,394 DEBUG [rs(jenkins-hbase4.apache.org,34205,1689185653087)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689185701599.ada568dc01c4278607317f7284319ab7. 2023-07-12 18:15:02,394 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 18:15:02,394 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 18:15:02,394 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:15:02,394 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-12 18:15:02,394 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,34205,1689185653087' in zk 2023-07-12 18:15:02,396 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-12 18:15:02,396 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 18:15:02,396 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-12 18:15:02,396 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:15:02,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:15:02,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 18:15:02,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 18:15:02,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 18:15:02,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 18:15:02,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:02,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:15:02,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:15:02,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:15:02,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 18:15:02,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:02,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:15:02,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:15:02,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,34205,1689185653087': 2023-07-12 18:15:02,405 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34205,1689185653087' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-12 18:15:02,405 DEBUG [rs(jenkins-hbase4.apache.org,37689,1689185653014)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689185701599.41d630f90edbdddf39cd8185ce69835e. completed. 2023-07-12 18:15:02,405 DEBUG [rs(jenkins-hbase4.apache.org,37689,1689185653014)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689185701599.41d630f90edbdddf39cd8185ce69835e. 2023-07-12 18:15:02,405 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 18:15:02,405 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 18:15:02,405 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:15:02,405 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-12 18:15:02,405 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,37689,1689185653014' in zk 2023-07-12 18:15:02,407 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:15:02,407 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-12 18:15:02,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:15:02,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 18:15:02,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 18:15:02,407 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 18:15:02,408 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-12 18:15:02,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 18:15:02,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 18:15:02,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:02,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:15:02,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:15:02,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:15:02,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 18:15:02,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:02,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:15:02,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:15:02,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:15:02,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,37689,1689185653014': 2023-07-12 18:15:02,418 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37689,1689185653014' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-12 18:15:02,418 INFO [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-07-12 18:15:02,418 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 18:15:02,418 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 18:15:02,418 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:02,418 INFO [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 18:15:02,420 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:02,420 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:15:02,420 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:02,420 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:02,421 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:02,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:02,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:02,420 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:02,420 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:15:02,420 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:02,421 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:15:02,421 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:02,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:02,421 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:15:02,421 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:15:02,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:15:02,422 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:15:02,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:15:02,422 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:15:02,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:15:02,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:02,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:02,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:02,423 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:15:02,423 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:15:02,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:02,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 18:15:02,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 18:15:02,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 18:15:02,425 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:15:02,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:02,425 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:15:02,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 18:15:02,426 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:15:02,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:02,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:15:02,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:15:02,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:15:02,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 18:15:02,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:02,431 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:15:02,431 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:15:02,431 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:15:02,431 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:15:02,431 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:15:02,431 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:02,431 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:15:02,431 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:15:02,431 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:15:02,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:15:02,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:15:02,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:15:02,431 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:15:02,432 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:02,432 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:15:02,432 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:02,432 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:15:02,432 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:15:02,432 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 18:15:02,432 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:15:02,432 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:15:02,433 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:15:02,432 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:02,435 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-07-12 18:15:02,435 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:02,435 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-12 18:15:02,435 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports because node does not exist (not an error) 2023-07-12 18:15:02,435 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:15:02,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:15:02,435 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:15:02,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:15:02,433 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:02,435 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:02,435 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:15:02,436 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-12 18:15:02,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:15:02,447 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:02,448 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:02,493 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:02,523 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-12 18:15:02,523 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:02,524 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:02,524 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689185702282Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1689185702447 (+165 ms)Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1689185702447Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1689185702447Writing data manifest for emptySnaptb0-testConsecutiveExports at 1689185702455 (+8 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1689185702484 (+29 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689185702523 (+39 ms) 2023-07-12 18:15:02,527 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-12 18:15:02,532 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 244 msec 2023-07-12 18:15:02,586 DEBUG [Listener at jenkins-hbase4.apache.org/41393] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 18:15:02,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-12 18:15:02,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 18:15:02,595 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37689] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1689185701599.41d630f90edbdddf39cd8185ce69835e. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 18:15:02,596 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34205] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1689185701599.ada568dc01c4278607317f7284319ab7. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 18:15:02,600 DEBUG [Listener at jenkins-hbase4.apache.org/41393] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-12 18:15:02,600 DEBUG [Listener at jenkins-hbase4.apache.org/41393] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1689185701599.41d630f90edbdddf39cd8185ce69835e. 2023-07-12 18:15:02,600 INFO [Listener at jenkins-hbase4.apache.org/41393] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 18:15:02,613 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-12 18:15:02,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689185702613 (current time:1689185702613). 2023-07-12 18:15:02,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 18:15:02,614 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] zookeeper.ReadOnlyZKClient(139): Connect 0x46d5fa40 to 127.0.0.1:62122 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 18:15:02,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7c8ca9b6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 18:15:02,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 18:15:02,633 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39854, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 18:15:02,634 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x46d5fa40 to 127.0.0.1:62122 2023-07-12 18:15:02,635 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 18:15:02,635 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] zookeeper.ReadOnlyZKClient(139): Connect 0x249c5013 to 127.0.0.1:62122 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 18:15:02,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4d72a93a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 18:15:02,644 DEBUG [hconnection-0x54aa683b-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 18:15:02,648 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39862, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 18:15:02,654 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x249c5013 to 127.0.0.1:62122 2023-07-12 18:15:02,654 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 18:15:02,654 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-12 18:15:02,655 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 18:15:02,655 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-12 18:15:02,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-12 18:15:02,659 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-12 18:15:02,660 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689186302660 2023-07-12 18:15:02,660 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-12 18:15:02,660 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-12 18:15:02,662 DEBUG [Listener at jenkins-hbase4.apache.org/41393] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 18:15:02,662 DEBUG [Listener at jenkins-hbase4.apache.org/41393] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 18:15:02,662 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-12 18:15:02,666 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-12 18:15:02,668 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 10 msec 2023-07-12 18:15:02,669 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-12 18:15:02,670 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689186302670 2023-07-12 18:15:02,679 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-07-12 18:15:02,679 INFO [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-07-12 18:15:02,679 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 18:15:02,681 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-07-12 18:15:02,681 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-12 18:15:02,681 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 18:15:02,681 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-12 18:15:02,682 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:15:02,682 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:15:02,683 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:15:02,682 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:15:02,682 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:15:02,683 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:15:02,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:15:02,683 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:15:02,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:15:02,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:15:02,683 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:15:02,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-12 18:15:02,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-12 18:15:02,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-12 18:15:02,683 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:15:02,684 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 18:15:02,684 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 18:15:02,684 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:15:02,684 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 18:15:02,684 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 18:15:02,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-12 18:15:02,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-12 18:15:02,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-12 18:15:02,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-12 18:15:02,684 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-12 18:15:02,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-12 18:15:02,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-12 18:15:02,684 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-12 18:15:02,684 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-12 18:15:02,684 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-12 18:15:02,684 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-12 18:15:02,684 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-12 18:15:02,685 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 18:15:02,685 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-12 18:15:02,686 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-12 18:15:02,685 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-12 18:15:02,686 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-12 18:15:02,686 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-12 18:15:02,686 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 18:15:02,686 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 18:15:02,686 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34493,1689185653159' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-12 18:15:02,688 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-12 18:15:02,688 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-12 18:15:02,687 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-12 18:15:02,688 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-12 18:15:02,688 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37689,1689185653014' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-12 18:15:02,688 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34205,1689185653087' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-12 18:15:02,690 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 18:15:02,691 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 18:15:02,691 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 18:15:02,691 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:15:02,691 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 18:15:02,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:15:02,691 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 18:15:02,691 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:15:02,691 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 18:15:02,691 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 18:15:02,691 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 18:15:02,691 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 18:15:02,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 18:15:02,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 18:15:02,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 18:15:02,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 18:15:02,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-12 18:15:02,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:15:02,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:15:02,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:15:02,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 18:15:02,693 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37689,1689185653014' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-12 18:15:02,694 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5dd4cd22[Count = 1] remaining members to acquire global barrier 2023-07-12 18:15:02,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:15:02,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 18:15:02,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 18:15:02,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 18:15:02,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 18:15:02,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-12 18:15:02,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:15:02,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:15:02,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:15:02,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 18:15:02,696 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34205,1689185653087' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-12 18:15:02,696 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5dd4cd22[Count = 0] remaining members to acquire global barrier 2023-07-12 18:15:02,696 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-12 18:15:02,696 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 18:15:02,698 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 18:15:02,698 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 18:15:02,698 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 18:15:02,699 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 18:15:02,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 18:15:02,698 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 18:15:02,699 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-12 18:15:02,699 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 18:15:02,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 18:15:02,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 18:15:02,699 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-12 18:15:02,699 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-12 18:15:02,699 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:15:02,699 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,34493,1689185653159' in zk 2023-07-12 18:15:02,699 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-12 18:15:02,699 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 18:15:02,699 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 18:15:02,699 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 18:15:02,699 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 18:15:02,699 DEBUG [rs(jenkins-hbase4.apache.org,34205,1689185653087)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689185701599.ada568dc01c4278607317f7284319ab7. 2023-07-12 18:15:02,700 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:15:02,700 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 18:15:02,700 DEBUG [rs(jenkins-hbase4.apache.org,34205,1689185653087)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689185701599.ada568dc01c4278607317f7284319ab7. started... 2023-07-12 18:15:02,700 DEBUG [rs(jenkins-hbase4.apache.org,37689,1689185653014)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689185701599.41d630f90edbdddf39cd8185ce69835e. 2023-07-12 18:15:02,701 DEBUG [rs(jenkins-hbase4.apache.org,37689,1689185653014)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689185701599.41d630f90edbdddf39cd8185ce69835e. started... 2023-07-12 18:15:02,701 INFO [rs(jenkins-hbase4.apache.org,34205,1689185653087)-snapshot-pool-0] regionserver.HRegion(2745): Flushing ada568dc01c4278607317f7284319ab7 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-07-12 18:15:02,701 INFO [rs(jenkins-hbase4.apache.org,37689,1689185653014)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 41d630f90edbdddf39cd8185ce69835e 1/1 column families, dataSize=333 B heapSize=976 B 2023-07-12 18:15:02,701 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-12 18:15:02,701 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 18:15:02,701 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-12 18:15:02,741 INFO [rs(jenkins-hbase4.apache.org,34205,1689185653087)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230712943dd6d9cf284d1fa8d9cee41e040a38 to hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230712943dd6d9cf284d1fa8d9cee41e040a38 2023-07-12 18:15:02,742 INFO [rs(jenkins-hbase4.apache.org,37689,1689185653014)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307126ea9f94c933746b589c286c1e92bbdfa to hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202307126ea9f94c933746b589c286c1e92bbdfa 2023-07-12 18:15:02,754 INFO [rs(jenkins-hbase4.apache.org,37689,1689185653014)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testConsecutiveExports/41d630f90edbdddf39cd8185ce69835e/.tmp/cf/6a2afb424bdc4286826912d5f963d5c4 2023-07-12 18:15:02,754 INFO [rs(jenkins-hbase4.apache.org,34205,1689185653087)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testConsecutiveExports/ada568dc01c4278607317f7284319ab7/.tmp/cf/5145f8d2d001469cbb4c0e806bbcab02 2023-07-12 18:15:02,760 DEBUG [rs(jenkins-hbase4.apache.org,37689,1689185653014)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testConsecutiveExports/41d630f90edbdddf39cd8185ce69835e/.tmp/cf/6a2afb424bdc4286826912d5f963d5c4 as hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testConsecutiveExports/41d630f90edbdddf39cd8185ce69835e/cf/6a2afb424bdc4286826912d5f963d5c4 2023-07-12 18:15:02,760 DEBUG [rs(jenkins-hbase4.apache.org,34205,1689185653087)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testConsecutiveExports/ada568dc01c4278607317f7284319ab7/.tmp/cf/5145f8d2d001469cbb4c0e806bbcab02 as hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testConsecutiveExports/ada568dc01c4278607317f7284319ab7/cf/5145f8d2d001469cbb4c0e806bbcab02 2023-07-12 18:15:02,762 DEBUG [Listener at jenkins-hbase4.apache.org/41393] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 18:15:02,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-12 18:15:02,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-12 18:15:02,764 DEBUG [Listener at jenkins-hbase4.apache.org/41393] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 18:15:02,766 INFO [rs(jenkins-hbase4.apache.org,34205,1689185653087)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testConsecutiveExports/ada568dc01c4278607317f7284319ab7/cf/5145f8d2d001469cbb4c0e806bbcab02, entries=45, sequenceid=6, filesize=12.4 K 2023-07-12 18:15:02,766 INFO [rs(jenkins-hbase4.apache.org,37689,1689185653014)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testConsecutiveExports/41d630f90edbdddf39cd8185ce69835e/cf/6a2afb424bdc4286826912d5f963d5c4, entries=5, sequenceid=6, filesize=5.7 K 2023-07-12 18:15:02,767 INFO [rs(jenkins-hbase4.apache.org,37689,1689185653014)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for 41d630f90edbdddf39cd8185ce69835e in 66ms, sequenceid=6, compaction requested=false 2023-07-12 18:15:02,767 INFO [rs(jenkins-hbase4.apache.org,34205,1689185653087)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for ada568dc01c4278607317f7284319ab7 in 66ms, sequenceid=6, compaction requested=false 2023-07-12 18:15:02,767 DEBUG [rs(jenkins-hbase4.apache.org,37689,1689185653014)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-12 18:15:02,767 DEBUG [rs(jenkins-hbase4.apache.org,34205,1689185653087)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-12 18:15:02,769 DEBUG [rs(jenkins-hbase4.apache.org,37689,1689185653014)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 41d630f90edbdddf39cd8185ce69835e: 2023-07-12 18:15:02,769 DEBUG [rs(jenkins-hbase4.apache.org,34205,1689185653087)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ada568dc01c4278607317f7284319ab7: 2023-07-12 18:15:02,770 DEBUG [rs(jenkins-hbase4.apache.org,37689,1689185653014)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689185701599.41d630f90edbdddf39cd8185ce69835e.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-12 18:15:02,770 DEBUG [rs(jenkins-hbase4.apache.org,34205,1689185653087)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689185701599.ada568dc01c4278607317f7284319ab7.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-12 18:15:02,770 DEBUG [rs(jenkins-hbase4.apache.org,37689,1689185653014)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 18:15:02,770 DEBUG [rs(jenkins-hbase4.apache.org,34205,1689185653087)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 18:15:02,770 DEBUG [rs(jenkins-hbase4.apache.org,37689,1689185653014)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testConsecutiveExports/41d630f90edbdddf39cd8185ce69835e/cf/6a2afb424bdc4286826912d5f963d5c4] hfiles 2023-07-12 18:15:02,770 DEBUG [rs(jenkins-hbase4.apache.org,34205,1689185653087)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testConsecutiveExports/ada568dc01c4278607317f7284319ab7/cf/5145f8d2d001469cbb4c0e806bbcab02] hfiles 2023-07-12 18:15:02,770 DEBUG [rs(jenkins-hbase4.apache.org,37689,1689185653014)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testConsecutiveExports/41d630f90edbdddf39cd8185ce69835e/cf/6a2afb424bdc4286826912d5f963d5c4 for snapshot=snaptb0-testConsecutiveExports 2023-07-12 18:15:02,770 DEBUG [rs(jenkins-hbase4.apache.org,34205,1689185653087)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testConsecutiveExports/ada568dc01c4278607317f7284319ab7/cf/5145f8d2d001469cbb4c0e806bbcab02 for snapshot=snaptb0-testConsecutiveExports 2023-07-12 18:15:02,786 DEBUG [rs(jenkins-hbase4.apache.org,37689,1689185653014)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689185701599.41d630f90edbdddf39cd8185ce69835e. completed. 2023-07-12 18:15:02,786 DEBUG [rs(jenkins-hbase4.apache.org,37689,1689185653014)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689185701599.41d630f90edbdddf39cd8185ce69835e. 2023-07-12 18:15:02,786 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 18:15:02,786 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 18:15:02,786 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:15:02,786 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-12 18:15:02,786 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,37689,1689185653014' in zk 2023-07-12 18:15:02,786 DEBUG [rs(jenkins-hbase4.apache.org,34205,1689185653087)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689185701599.ada568dc01c4278607317f7284319ab7. completed. 2023-07-12 18:15:02,787 DEBUG [rs(jenkins-hbase4.apache.org,34205,1689185653087)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689185701599.ada568dc01c4278607317f7284319ab7. 2023-07-12 18:15:02,787 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 18:15:02,787 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 18:15:02,787 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:15:02,787 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-12 18:15:02,787 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,34205,1689185653087' in zk 2023-07-12 18:15:02,788 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-12 18:15:02,788 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:15:02,788 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 18:15:02,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:15:02,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 18:15:02,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 18:15:02,788 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-12 18:15:02,790 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:15:02,790 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-12 18:15:02,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 18:15:02,790 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 18:15:02,790 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-12 18:15:02,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 18:15:02,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-12 18:15:02,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:15:02,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:15:02,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:15:02,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 18:15:02,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-12 18:15:02,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:15:02,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:15:02,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:15:02,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,37689,1689185653014': 2023-07-12 18:15:02,794 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37689,1689185653014' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-12 18:15:02,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:15:02,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 18:15:02,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 18:15:02,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 18:15:02,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 18:15:02,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-12 18:15:02,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:15:02,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:15:02,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:15:02,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 18:15:02,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-12 18:15:02,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:15:02,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:15:02,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:15:02,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,34205,1689185653087': 2023-07-12 18:15:02,797 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34205,1689185653087' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-12 18:15:02,797 INFO [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-07-12 18:15:02,797 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 18:15:02,797 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 18:15:02,797 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-07-12 18:15:02,797 INFO [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 18:15:02,799 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 18:15:02,799 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 18:15:02,799 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 18:15:02,799 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 18:15:02,799 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:15:02,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 18:15:02,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 18:15:02,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 18:15:02,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 18:15:02,799 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 18:15:02,799 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:15:02,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 18:15:02,799 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 18:15:02,800 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:15:02,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 18:15:02,800 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 18:15:02,800 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:15:02,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:15:02,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 18:15:02,800 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:15:02,800 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:15:02,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:15:02,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-12 18:15:02,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 18:15:02,800 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:15:02,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:15:02,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 18:15:02,800 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:15:02,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 18:15:02,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 18:15:02,801 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:15:02,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-12 18:15:02,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:15:02,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:15:02,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:15:02,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 18:15:02,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-12 18:15:02,803 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:15:02,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:15:02,803 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:15:02,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:15:02,803 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:15:02,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:15:02,814 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:15:02,814 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:15:02,814 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:15:02,814 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:15:02,815 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 18:15:02,814 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:15:02,814 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:15:02,816 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-12 18:15:02,816 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:15:02,816 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:15:02,815 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-07-12 18:15:02,814 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:15:02,816 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-07-12 18:15:02,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:15:02,814 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:15:02,816 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-12 18:15:02,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:15:02,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:15:02,817 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-12 18:15:02,816 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:15:02,817 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:15:02,817 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-12 18:15:02,817 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:15:02,817 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:15:02,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:15:02,817 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 18:15:02,817 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:15:02,817 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:15:02,817 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 18:15:02,817 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:15:02,817 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:15:02,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:15:02,817 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 18:15:02,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:15:02,818 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230712943dd6d9cf284d1fa8d9cee41e040a38, hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202307126ea9f94c933746b589c286c1e92bbdfa] mob files 2023-07-12 18:15:02,818 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230712943dd6d9cf284d1fa8d9cee41e040a38 2023-07-12 18:15:02,818 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202307126ea9f94c933746b589c286c1e92bbdfa 2023-07-12 18:15:02,832 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-07-12 18:15:02,832 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-12 18:15:02,850 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-12 18:15:02,874 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-12 18:15:02,875 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-12 18:15:02,875 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-12 18:15:02,875 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689185702660Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1689185702832 (+172 ms)Consolidate snapshot: snaptb0-testConsecutiveExports at 1689185702832Loading Region manifests for snaptb0-testConsecutiveExports at 1689185702832Writing data manifest for snaptb0-testConsecutiveExports at 1689185702836 (+4 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1689185702844 (+8 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689185702874 (+30 ms) 2023-07-12 18:15:02,878 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-12 18:15:02,879 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 216 msec 2023-07-12 18:15:02,964 DEBUG [Listener at jenkins-hbase4.apache.org/41393] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 18:15:02,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-12 18:15:02,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 18:15:02,965 INFO [Listener at jenkins-hbase4.apache.org/41393] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/908563f7-ecc5-f8cf-2e08-f8e1a8353ad0/local-export-1689185702965 2023-07-12 18:15:02,965 INFO [Listener at jenkins-hbase4.apache.org/41393] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/908563f7-ecc5-f8cf-2e08-f8e1a8353ad0/local-export-1689185702965, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/908563f7-ecc5-f8cf-2e08-f8e1a8353ad0/local-export-1689185702965, srcFsUri=hdfs://localhost:38679, srcDir=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0 2023-07-12 18:15:02,988 DEBUG [Listener at jenkins-hbase4.apache.org/41393] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:38679, inputRoot=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0 2023-07-12 18:15:02,988 DEBUG [Listener at jenkins-hbase4.apache.org/41393] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@4471db93, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/908563f7-ecc5-f8cf-2e08-f8e1a8353ad0/local-export-1689185702965, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/908563f7-ecc5-f8cf-2e08-f8e1a8353ad0/local-export-1689185702965/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-12 18:15:02,988 INFO [Listener at jenkins-hbase4.apache.org/41393] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:38679, inputRoot=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0, snapshotDir=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-12 18:15:02,997 INFO [Listener at jenkins-hbase4.apache.org/41393] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/908563f7-ecc5-f8cf-2e08-f8e1a8353ad0/local-export-1689185702965/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-12 18:15:03,008 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-12 18:15:03,008 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-12 18:15:03,009 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-12 18:15:03,009 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-12 18:15:03,947 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/908563f7-ecc5-f8cf-2e08-f8e1a8353ad0/hadoop-5084841039871267120.jar 2023-07-12 18:15:03,947 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-12 18:15:03,948 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-12 18:15:04,017 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/908563f7-ecc5-f8cf-2e08-f8e1a8353ad0/hadoop-796146264045725777.jar 2023-07-12 18:15:04,017 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-12 18:15:04,018 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-12 18:15:04,018 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-12 18:15:04,019 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-12 18:15:04,019 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-12 18:15:04,019 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-12 18:15:04,020 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-12 18:15:04,020 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-12 18:15:04,020 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-12 18:15:04,021 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-12 18:15:04,021 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-12 18:15:04,022 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-12 18:15:04,022 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-12 18:15:04,022 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-12 18:15:04,023 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-12 18:15:04,023 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-12 18:15:04,024 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 18:15:04,024 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 18:15:04,025 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 18:15:04,025 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 18:15:04,025 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 18:15:04,026 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 18:15:04,026 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 18:15:04,522 WARN [Listener at jenkins-hbase4.apache.org/41393] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-12 18:15:04,525 INFO [Listener at jenkins-hbase4.apache.org/41393] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-12 18:15:04,528 DEBUG [Listener at jenkins-hbase4.apache.org/41393] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-07-12 18:15:05,917 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 18:15:05,917 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 18:15:05,920 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689185662417_0002_000001 (auth:SIMPLE) 2023-07-12 18:15:06,690 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689185662417_0003_000001 (auth:SIMPLE) 2023-07-12 18:15:06,888 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-12 18:15:11,240 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689185662417_0003_000001 (auth:SIMPLE) 2023-07-12 18:15:13,496 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689185662417_0003_000001 (auth:SIMPLE) 2023-07-12 18:15:16,020 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689185662417_0003_000001 (auth:SIMPLE) 2023-07-12 18:15:17,700 INFO [Listener at jenkins-hbase4.apache.org/41393] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-12 18:15:17,701 INFO [Listener at jenkins-hbase4.apache.org/41393] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-12 18:15:17,705 INFO [Listener at jenkins-hbase4.apache.org/41393] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-12 18:15:17,706 INFO [Listener at jenkins-hbase4.apache.org/41393] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-12 18:15:17,706 INFO [Listener at jenkins-hbase4.apache.org/41393] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-12 18:15:17,706 DEBUG [Listener at jenkins-hbase4.apache.org/41393] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-639947816_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-12 18:15:17,709 DEBUG [Listener at jenkins-hbase4.apache.org/41393] snapshot.TestExportSnapshot(367): hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-12 18:15:17,709 DEBUG [Listener at jenkins-hbase4.apache.org/41393] snapshot.TestExportSnapshot(367): hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-12 18:15:17,710 DEBUG [Listener at jenkins-hbase4.apache.org/41393] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@4b97cf9 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/908563f7-ecc5-f8cf-2e08-f8e1a8353ad0/local-export-1689185702965/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/908563f7-ecc5-f8cf-2e08-f8e1a8353ad0/local-export-1689185702965/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-12 18:15:17,710 DEBUG [Listener at jenkins-hbase4.apache.org/41393] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/908563f7-ecc5-f8cf-2e08-f8e1a8353ad0/local-export-1689185702965/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-12 18:15:17,710 DEBUG [Listener at jenkins-hbase4.apache.org/41393] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/908563f7-ecc5-f8cf-2e08-f8e1a8353ad0/local-export-1689185702965/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-12 18:15:17,711 INFO [Listener at jenkins-hbase4.apache.org/41393] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/908563f7-ecc5-f8cf-2e08-f8e1a8353ad0/local-export-1689185702965, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/908563f7-ecc5-f8cf-2e08-f8e1a8353ad0/local-export-1689185702965, srcFsUri=hdfs://localhost:38679, srcDir=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0 2023-07-12 18:15:17,734 DEBUG [Listener at jenkins-hbase4.apache.org/41393] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:38679, inputRoot=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0 2023-07-12 18:15:17,734 DEBUG [Listener at jenkins-hbase4.apache.org/41393] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@393e9169, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/908563f7-ecc5-f8cf-2e08-f8e1a8353ad0/local-export-1689185702965, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/908563f7-ecc5-f8cf-2e08-f8e1a8353ad0/local-export-1689185702965/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-12 18:15:17,734 INFO [Listener at jenkins-hbase4.apache.org/41393] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:38679, inputRoot=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0, snapshotDir=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-12 18:15:17,746 INFO [Listener at jenkins-hbase4.apache.org/41393] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/908563f7-ecc5-f8cf-2e08-f8e1a8353ad0/local-export-1689185702965/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-12 18:15:17,758 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-12 18:15:17,758 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-12 18:15:17,759 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-12 18:15:17,759 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-12 18:15:18,676 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/908563f7-ecc5-f8cf-2e08-f8e1a8353ad0/hadoop-4136196487699828894.jar 2023-07-12 18:15:18,676 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-12 18:15:18,677 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-12 18:15:18,745 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/908563f7-ecc5-f8cf-2e08-f8e1a8353ad0/hadoop-4678712910147699459.jar 2023-07-12 18:15:18,746 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-12 18:15:18,746 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-12 18:15:18,747 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-12 18:15:18,747 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-12 18:15:18,748 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-12 18:15:18,748 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-12 18:15:18,749 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-12 18:15:18,749 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-12 18:15:18,749 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-12 18:15:18,750 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-12 18:15:18,750 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-12 18:15:18,751 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-12 18:15:18,751 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-12 18:15:18,752 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-12 18:15:18,752 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-12 18:15:18,753 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-12 18:15:18,754 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 18:15:18,754 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 18:15:18,755 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 18:15:18,755 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 18:15:18,755 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 18:15:18,756 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 18:15:18,757 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 18:15:19,125 WARN [Listener at jenkins-hbase4.apache.org/41393] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-12 18:15:19,127 INFO [Listener at jenkins-hbase4.apache.org/41393] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-12 18:15:19,129 DEBUG [Listener at jenkins-hbase4.apache.org/41393] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-07-12 18:15:22,196 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 18:15:22,196 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 18:15:22,199 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689185662417_0003_000001 (auth:SIMPLE) 2023-07-12 18:15:22,935 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689185662417_0004_000001 (auth:SIMPLE) 2023-07-12 18:15:28,786 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689185662417_0004_000001 (auth:SIMPLE) 2023-07-12 18:15:31,229 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689185662417_0004_000001 (auth:SIMPLE) 2023-07-12 18:15:36,346 INFO [Listener at jenkins-hbase4.apache.org/41393] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-12 18:15:36,346 INFO [Listener at jenkins-hbase4.apache.org/41393] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-12 18:15:36,349 INFO [Listener at jenkins-hbase4.apache.org/41393] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-12 18:15:36,350 INFO [Listener at jenkins-hbase4.apache.org/41393] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-12 18:15:36,350 INFO [Listener at jenkins-hbase4.apache.org/41393] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-12 18:15:36,350 DEBUG [Listener at jenkins-hbase4.apache.org/41393] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-639947816_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-12 18:15:36,353 DEBUG [Listener at jenkins-hbase4.apache.org/41393] snapshot.TestExportSnapshot(367): hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-12 18:15:36,353 DEBUG [Listener at jenkins-hbase4.apache.org/41393] snapshot.TestExportSnapshot(367): hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-12 18:15:36,353 DEBUG [Listener at jenkins-hbase4.apache.org/41393] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@4b97cf9 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/908563f7-ecc5-f8cf-2e08-f8e1a8353ad0/local-export-1689185702965/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/908563f7-ecc5-f8cf-2e08-f8e1a8353ad0/local-export-1689185702965/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-12 18:15:36,354 DEBUG [Listener at jenkins-hbase4.apache.org/41393] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/908563f7-ecc5-f8cf-2e08-f8e1a8353ad0/local-export-1689185702965/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-12 18:15:36,354 DEBUG [Listener at jenkins-hbase4.apache.org/41393] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/908563f7-ecc5-f8cf-2e08-f8e1a8353ad0/local-export-1689185702965/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-12 18:15:36,373 INFO [Listener at jenkins-hbase4.apache.org/41393] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-07-12 18:15:36,373 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-07-12 18:15:36,375 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] procedure2.ProcedureExecutor(1029): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-07-12 18:15:36,379 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-12 18:15:36,380 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689185736379"}]},"ts":"1689185736379"} 2023-07-12 18:15:36,381 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-07-12 18:15:36,383 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-07-12 18:15:36,384 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=41d630f90edbdddf39cd8185ce69835e, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ada568dc01c4278607317f7284319ab7, UNASSIGN}] 2023-07-12 18:15:36,386 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=41d630f90edbdddf39cd8185ce69835e, UNASSIGN 2023-07-12 18:15:36,386 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ada568dc01c4278607317f7284319ab7, UNASSIGN 2023-07-12 18:15:36,387 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=ada568dc01c4278607317f7284319ab7, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:15:36,387 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=41d630f90edbdddf39cd8185ce69835e, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:15:36,387 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689185701599.ada568dc01c4278607317f7284319ab7.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689185736387"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689185736387"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689185736387"}]},"ts":"1689185736387"} 2023-07-12 18:15:36,387 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689185701599.41d630f90edbdddf39cd8185ce69835e.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689185736387"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689185736387"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689185736387"}]},"ts":"1689185736387"} 2023-07-12 18:15:36,389 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=54, ppid=53, state=RUNNABLE; CloseRegionProcedure ada568dc01c4278607317f7284319ab7, server=jenkins-hbase4.apache.org,34205,1689185653087}] 2023-07-12 18:15:36,390 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=55, ppid=52, state=RUNNABLE; CloseRegionProcedure 41d630f90edbdddf39cd8185ce69835e, server=jenkins-hbase4.apache.org,37689,1689185653014}] 2023-07-12 18:15:36,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-12 18:15:36,544 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close ada568dc01c4278607317f7284319ab7 2023-07-12 18:15:36,544 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ada568dc01c4278607317f7284319ab7, disabling compactions & flushes 2023-07-12 18:15:36,544 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689185701599.ada568dc01c4278607317f7284319ab7. 2023-07-12 18:15:36,545 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689185701599.ada568dc01c4278607317f7284319ab7. 2023-07-12 18:15:36,545 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689185701599.ada568dc01c4278607317f7284319ab7. after waiting 0 ms 2023-07-12 18:15:36,545 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689185701599.ada568dc01c4278607317f7284319ab7. 2023-07-12 18:15:36,545 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 41d630f90edbdddf39cd8185ce69835e 2023-07-12 18:15:36,545 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 41d630f90edbdddf39cd8185ce69835e, disabling compactions & flushes 2023-07-12 18:15:36,545 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689185701599.41d630f90edbdddf39cd8185ce69835e. 2023-07-12 18:15:36,545 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689185701599.41d630f90edbdddf39cd8185ce69835e. 2023-07-12 18:15:36,545 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689185701599.41d630f90edbdddf39cd8185ce69835e. after waiting 0 ms 2023-07-12 18:15:36,545 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689185701599.41d630f90edbdddf39cd8185ce69835e. 2023-07-12 18:15:36,561 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testConsecutiveExports/41d630f90edbdddf39cd8185ce69835e/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 18:15:36,561 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testConsecutiveExports/ada568dc01c4278607317f7284319ab7/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 18:15:36,561 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 18:15:36,561 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 18:15:36,562 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689185701599.41d630f90edbdddf39cd8185ce69835e. 2023-07-12 18:15:36,563 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 41d630f90edbdddf39cd8185ce69835e: 2023-07-12 18:15:36,563 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689185701599.ada568dc01c4278607317f7284319ab7. 2023-07-12 18:15:36,563 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ada568dc01c4278607317f7284319ab7: 2023-07-12 18:15:36,565 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 41d630f90edbdddf39cd8185ce69835e 2023-07-12 18:15:36,566 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=41d630f90edbdddf39cd8185ce69835e, regionState=CLOSED 2023-07-12 18:15:36,566 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689185701599.41d630f90edbdddf39cd8185ce69835e.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689185736566"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689185736566"}]},"ts":"1689185736566"} 2023-07-12 18:15:36,566 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed ada568dc01c4278607317f7284319ab7 2023-07-12 18:15:36,567 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=ada568dc01c4278607317f7284319ab7, regionState=CLOSED 2023-07-12 18:15:36,567 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689185701599.ada568dc01c4278607317f7284319ab7.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689185736567"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689185736567"}]},"ts":"1689185736567"} 2023-07-12 18:15:36,570 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=55, resume processing ppid=52 2023-07-12 18:15:36,570 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=55, ppid=52, state=SUCCESS; CloseRegionProcedure 41d630f90edbdddf39cd8185ce69835e, server=jenkins-hbase4.apache.org,37689,1689185653014 in 178 msec 2023-07-12 18:15:36,572 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=41d630f90edbdddf39cd8185ce69835e, UNASSIGN in 186 msec 2023-07-12 18:15:36,572 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=54, resume processing ppid=53 2023-07-12 18:15:36,572 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=54, ppid=53, state=SUCCESS; CloseRegionProcedure ada568dc01c4278607317f7284319ab7, server=jenkins-hbase4.apache.org,34205,1689185653087 in 181 msec 2023-07-12 18:15:36,574 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=51 2023-07-12 18:15:36,574 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ada568dc01c4278607317f7284319ab7, UNASSIGN in 188 msec 2023-07-12 18:15:36,574 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689185736574"}]},"ts":"1689185736574"} 2023-07-12 18:15:36,577 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-07-12 18:15:36,579 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-07-12 18:15:36,583 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 207 msec 2023-07-12 18:15:36,683 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-12 18:15:36,683 INFO [Listener at jenkins-hbase4.apache.org/41393] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-07-12 18:15:36,684 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-07-12 18:15:36,686 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] procedure2.ProcedureExecutor(1029): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-12 18:15:36,689 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-12 18:15:36,689 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-07-12 18:15:36,689 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-12 18:15:36,695 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34493] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-07-12 18:15:36,697 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testConsecutiveExports/41d630f90edbdddf39cd8185ce69835e 2023-07-12 18:15:36,700 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testConsecutiveExports/ada568dc01c4278607317f7284319ab7 2023-07-12 18:15:36,700 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-12 18:15:36,700 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-12 18:15:36,700 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-12 18:15:36,700 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-12 18:15:36,700 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-12 18:15:36,701 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-12 18:15:36,701 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-12 18:15:36,701 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 18:15:36,701 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 18:15:36,701 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 18:15:36,702 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data null 2023-07-12 18:15:36,702 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-12 18:15:36,702 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testConsecutiveExports/41d630f90edbdddf39cd8185ce69835e/cf, FileablePath, hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testConsecutiveExports/41d630f90edbdddf39cd8185ce69835e/recovered.edits] 2023-07-12 18:15:36,702 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testConsecutiveExports/ada568dc01c4278607317f7284319ab7/cf, FileablePath, hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testConsecutiveExports/ada568dc01c4278607317f7284319ab7/recovered.edits] 2023-07-12 18:15:36,702 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-12 18:15:36,702 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-12 18:15:36,702 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 18:15:36,703 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data null 2023-07-12 18:15:36,703 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-12 18:15:36,715 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testConsecutiveExports/41d630f90edbdddf39cd8185ce69835e/cf/6a2afb424bdc4286826912d5f963d5c4 to hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/archive/data/default/testtb-testConsecutiveExports/41d630f90edbdddf39cd8185ce69835e/cf/6a2afb424bdc4286826912d5f963d5c4 2023-07-12 18:15:36,715 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testConsecutiveExports/ada568dc01c4278607317f7284319ab7/cf/5145f8d2d001469cbb4c0e806bbcab02 to hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/archive/data/default/testtb-testConsecutiveExports/ada568dc01c4278607317f7284319ab7/cf/5145f8d2d001469cbb4c0e806bbcab02 2023-07-12 18:15:36,719 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testConsecutiveExports/41d630f90edbdddf39cd8185ce69835e/recovered.edits/9.seqid to hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/archive/data/default/testtb-testConsecutiveExports/41d630f90edbdddf39cd8185ce69835e/recovered.edits/9.seqid 2023-07-12 18:15:36,720 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testConsecutiveExports/41d630f90edbdddf39cd8185ce69835e 2023-07-12 18:15:36,720 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testConsecutiveExports/ada568dc01c4278607317f7284319ab7/recovered.edits/9.seqid to hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/archive/data/default/testtb-testConsecutiveExports/ada568dc01c4278607317f7284319ab7/recovered.edits/9.seqid 2023-07-12 18:15:36,721 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testConsecutiveExports/ada568dc01c4278607317f7284319ab7 2023-07-12 18:15:36,721 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-12 18:15:36,721 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-07-12 18:15:36,723 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf] 2023-07-12 18:15:36,727 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230712943dd6d9cf284d1fa8d9cee41e040a38 to hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230712943dd6d9cf284d1fa8d9cee41e040a38 2023-07-12 18:15:36,730 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202307126ea9f94c933746b589c286c1e92bbdfa to hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202307126ea9f94c933746b589c286c1e92bbdfa 2023-07-12 18:15:36,730 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-07-12 18:15:36,733 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-12 18:15:36,736 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-07-12 18:15:36,745 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-07-12 18:15:36,746 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-12 18:15:36,746 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-07-12 18:15:36,747 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1689185701599.41d630f90edbdddf39cd8185ce69835e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689185736746"}]},"ts":"9223372036854775807"} 2023-07-12 18:15:36,747 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1689185701599.ada568dc01c4278607317f7284319ab7.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689185736746"}]},"ts":"9223372036854775807"} 2023-07-12 18:15:36,749 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-12 18:15:36,749 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 41d630f90edbdddf39cd8185ce69835e, NAME => 'testtb-testConsecutiveExports,,1689185701599.41d630f90edbdddf39cd8185ce69835e.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => ada568dc01c4278607317f7284319ab7, NAME => 'testtb-testConsecutiveExports,1,1689185701599.ada568dc01c4278607317f7284319ab7.', STARTKEY => '1', ENDKEY => ''}] 2023-07-12 18:15:36,749 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-07-12 18:15:36,749 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689185736749"}]},"ts":"9223372036854775807"} 2023-07-12 18:15:36,751 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-07-12 18:15:36,755 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-12 18:15:36,768 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 71 msec 2023-07-12 18:15:36,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-12 18:15:36,804 INFO [Listener at jenkins-hbase4.apache.org/41393] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-07-12 18:15:36,821 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-07-12 18:15:36,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:36,826 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-07-12 18:15:36,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-07-12 18:15:36,862 INFO [Listener at jenkins-hbase4.apache.org/41393] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=746 (was 761), OpenFileDescriptor=892 (was 929), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=498 (was 324) - SystemLoadAverage LEAK? -, ProcessCount=179 (was 179), AvailableMemoryMB=4380 (was 4934) 2023-07-12 18:15:36,862 WARN [Listener at jenkins-hbase4.apache.org/41393] hbase.ResourceChecker(130): Thread=746 is superior to 500 2023-07-12 18:15:36,887 INFO [Listener at jenkins-hbase4.apache.org/41393] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=746, OpenFileDescriptor=892, MaxFileDescriptor=60000, SystemLoadAverage=498, ProcessCount=179, AvailableMemoryMB=4377 2023-07-12 18:15:36,887 WARN [Listener at jenkins-hbase4.apache.org/41393] hbase.ResourceChecker(130): Thread=746 is superior to 500 2023-07-12 18:15:36,890 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-12 18:15:36,892 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] procedure2.ProcedureExecutor(1029): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:36,897 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 18:15:36,898 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-07-12 18:15:36,899 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 18:15:36,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-12 18:15:36,903 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/5ac33830d086b3a7de54a793dff578ae 2023-07-12 18:15:36,903 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/4f7f7d9d9128a95660641bdd0b71a19c 2023-07-12 18:15:36,903 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/4f7f7d9d9128a95660641bdd0b71a19c empty. 2023-07-12 18:15:36,903 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/5ac33830d086b3a7de54a793dff578ae empty. 2023-07-12 18:15:36,904 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/4f7f7d9d9128a95660641bdd0b71a19c 2023-07-12 18:15:36,904 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/5ac33830d086b3a7de54a793dff578ae 2023-07-12 18:15:36,905 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-12 18:15:36,928 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-07-12 18:15:36,930 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => 4f7f7d9d9128a95660641bdd0b71a19c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689185736889.4f7f7d9d9128a95660641bdd0b71a19c.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp 2023-07-12 18:15:36,934 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => 5ac33830d086b3a7de54a793dff578ae, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689185736889.5ac33830d086b3a7de54a793dff578ae.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp 2023-07-12 18:15:36,951 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689185736889.4f7f7d9d9128a95660641bdd0b71a19c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 18:15:36,951 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing 4f7f7d9d9128a95660641bdd0b71a19c, disabling compactions & flushes 2023-07-12 18:15:36,951 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689185736889.4f7f7d9d9128a95660641bdd0b71a19c. 2023-07-12 18:15:36,951 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689185736889.4f7f7d9d9128a95660641bdd0b71a19c. 2023-07-12 18:15:36,951 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689185736889.4f7f7d9d9128a95660641bdd0b71a19c. after waiting 0 ms 2023-07-12 18:15:36,951 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689185736889.4f7f7d9d9128a95660641bdd0b71a19c. 2023-07-12 18:15:36,951 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689185736889.4f7f7d9d9128a95660641bdd0b71a19c. 2023-07-12 18:15:36,951 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for 4f7f7d9d9128a95660641bdd0b71a19c: 2023-07-12 18:15:36,953 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689185736889.5ac33830d086b3a7de54a793dff578ae.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 18:15:36,953 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing 5ac33830d086b3a7de54a793dff578ae, disabling compactions & flushes 2023-07-12 18:15:36,953 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689185736889.5ac33830d086b3a7de54a793dff578ae. 2023-07-12 18:15:36,953 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689185736889.5ac33830d086b3a7de54a793dff578ae. 2023-07-12 18:15:36,953 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689185736889.5ac33830d086b3a7de54a793dff578ae. after waiting 0 ms 2023-07-12 18:15:36,953 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689185736889.5ac33830d086b3a7de54a793dff578ae. 2023-07-12 18:15:36,953 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689185736889.5ac33830d086b3a7de54a793dff578ae. 2023-07-12 18:15:36,953 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for 5ac33830d086b3a7de54a793dff578ae: 2023-07-12 18:15:36,956 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 18:15:36,957 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689185736889.4f7f7d9d9128a95660641bdd0b71a19c.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689185736957"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689185736957"}]},"ts":"1689185736957"} 2023-07-12 18:15:36,958 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689185736889.5ac33830d086b3a7de54a793dff578ae.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689185736957"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689185736957"}]},"ts":"1689185736957"} 2023-07-12 18:15:36,971 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-12 18:15:36,972 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 18:15:36,972 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689185736972"}]},"ts":"1689185736972"} 2023-07-12 18:15:36,974 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-07-12 18:15:36,980 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-12 18:15:36,982 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 18:15:36,982 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 18:15:36,982 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-12 18:15:36,982 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 18:15:36,982 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=4f7f7d9d9128a95660641bdd0b71a19c, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=5ac33830d086b3a7de54a793dff578ae, ASSIGN}] 2023-07-12 18:15:36,985 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=5ac33830d086b3a7de54a793dff578ae, ASSIGN 2023-07-12 18:15:36,985 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=4f7f7d9d9128a95660641bdd0b71a19c, ASSIGN 2023-07-12 18:15:36,985 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=5ac33830d086b3a7de54a793dff578ae, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34493,1689185653159; forceNewPlan=false, retain=false 2023-07-12 18:15:36,985 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=4f7f7d9d9128a95660641bdd0b71a19c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34205,1689185653087; forceNewPlan=false, retain=false 2023-07-12 18:15:37,001 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-12 18:15:37,136 INFO [jenkins-hbase4:43177] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-12 18:15:37,140 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=5ac33830d086b3a7de54a793dff578ae, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:15:37,140 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689185736889.5ac33830d086b3a7de54a793dff578ae.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689185737140"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689185737140"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689185737140"}]},"ts":"1689185737140"} 2023-07-12 18:15:37,141 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=4f7f7d9d9128a95660641bdd0b71a19c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:15:37,141 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689185736889.4f7f7d9d9128a95660641bdd0b71a19c.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689185737140"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689185737140"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689185737140"}]},"ts":"1689185737140"} 2023-07-12 18:15:37,143 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE; OpenRegionProcedure 5ac33830d086b3a7de54a793dff578ae, server=jenkins-hbase4.apache.org,34493,1689185653159}] 2023-07-12 18:15:37,144 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=58, state=RUNNABLE; OpenRegionProcedure 4f7f7d9d9128a95660641bdd0b71a19c, server=jenkins-hbase4.apache.org,34205,1689185653087}] 2023-07-12 18:15:37,202 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-12 18:15:37,304 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1689185736889.4f7f7d9d9128a95660641bdd0b71a19c. 2023-07-12 18:15:37,305 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4f7f7d9d9128a95660641bdd0b71a19c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689185736889.4f7f7d9d9128a95660641bdd0b71a19c.', STARTKEY => '', ENDKEY => '1'} 2023-07-12 18:15:37,307 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1689185736889.4f7f7d9d9128a95660641bdd0b71a19c. service=AccessControlService 2023-07-12 18:15:37,307 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 18:15:37,307 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 4f7f7d9d9128a95660641bdd0b71a19c 2023-07-12 18:15:37,307 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689185736889.4f7f7d9d9128a95660641bdd0b71a19c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 18:15:37,307 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 4f7f7d9d9128a95660641bdd0b71a19c 2023-07-12 18:15:37,307 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 4f7f7d9d9128a95660641bdd0b71a19c 2023-07-12 18:15:37,308 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1689185736889.5ac33830d086b3a7de54a793dff578ae. 2023-07-12 18:15:37,309 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5ac33830d086b3a7de54a793dff578ae, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689185736889.5ac33830d086b3a7de54a793dff578ae.', STARTKEY => '1', ENDKEY => ''} 2023-07-12 18:15:37,309 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1689185736889.5ac33830d086b3a7de54a793dff578ae. service=AccessControlService 2023-07-12 18:15:37,309 INFO [StoreOpener-4f7f7d9d9128a95660641bdd0b71a19c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 4f7f7d9d9128a95660641bdd0b71a19c 2023-07-12 18:15:37,309 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 18:15:37,309 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 5ac33830d086b3a7de54a793dff578ae 2023-07-12 18:15:37,309 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689185736889.5ac33830d086b3a7de54a793dff578ae.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 18:15:37,309 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 5ac33830d086b3a7de54a793dff578ae 2023-07-12 18:15:37,309 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 5ac33830d086b3a7de54a793dff578ae 2023-07-12 18:15:37,311 DEBUG [StoreOpener-4f7f7d9d9128a95660641bdd0b71a19c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testExportFileSystemStateWithMergeRegion/4f7f7d9d9128a95660641bdd0b71a19c/cf 2023-07-12 18:15:37,311 DEBUG [StoreOpener-4f7f7d9d9128a95660641bdd0b71a19c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testExportFileSystemStateWithMergeRegion/4f7f7d9d9128a95660641bdd0b71a19c/cf 2023-07-12 18:15:37,312 INFO [StoreOpener-4f7f7d9d9128a95660641bdd0b71a19c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4f7f7d9d9128a95660641bdd0b71a19c columnFamilyName cf 2023-07-12 18:15:37,314 INFO [StoreOpener-4f7f7d9d9128a95660641bdd0b71a19c-1] regionserver.HStore(310): Store=4f7f7d9d9128a95660641bdd0b71a19c/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 18:15:37,315 INFO [StoreOpener-5ac33830d086b3a7de54a793dff578ae-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 5ac33830d086b3a7de54a793dff578ae 2023-07-12 18:15:37,315 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testExportFileSystemStateWithMergeRegion/4f7f7d9d9128a95660641bdd0b71a19c 2023-07-12 18:15:37,316 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testExportFileSystemStateWithMergeRegion/4f7f7d9d9128a95660641bdd0b71a19c 2023-07-12 18:15:37,316 DEBUG [StoreOpener-5ac33830d086b3a7de54a793dff578ae-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testExportFileSystemStateWithMergeRegion/5ac33830d086b3a7de54a793dff578ae/cf 2023-07-12 18:15:37,316 DEBUG [StoreOpener-5ac33830d086b3a7de54a793dff578ae-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testExportFileSystemStateWithMergeRegion/5ac33830d086b3a7de54a793dff578ae/cf 2023-07-12 18:15:37,317 INFO [StoreOpener-5ac33830d086b3a7de54a793dff578ae-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5ac33830d086b3a7de54a793dff578ae columnFamilyName cf 2023-07-12 18:15:37,320 INFO [StoreOpener-5ac33830d086b3a7de54a793dff578ae-1] regionserver.HStore(310): Store=5ac33830d086b3a7de54a793dff578ae/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 18:15:37,321 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testExportFileSystemStateWithMergeRegion/5ac33830d086b3a7de54a793dff578ae 2023-07-12 18:15:37,321 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testExportFileSystemStateWithMergeRegion/5ac33830d086b3a7de54a793dff578ae 2023-07-12 18:15:37,323 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 4f7f7d9d9128a95660641bdd0b71a19c 2023-07-12 18:15:37,325 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 5ac33830d086b3a7de54a793dff578ae 2023-07-12 18:15:37,331 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testExportFileSystemStateWithMergeRegion/5ac33830d086b3a7de54a793dff578ae/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 18:15:37,332 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 5ac33830d086b3a7de54a793dff578ae; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65713670, jitterRate=-0.020790010690689087}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 18:15:37,332 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 5ac33830d086b3a7de54a793dff578ae: 2023-07-12 18:15:37,333 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testExportFileSystemStateWithMergeRegion/4f7f7d9d9128a95660641bdd0b71a19c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 18:15:37,333 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 4f7f7d9d9128a95660641bdd0b71a19c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74007636, jitterRate=0.10279971361160278}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 18:15:37,334 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 4f7f7d9d9128a95660641bdd0b71a19c: 2023-07-12 18:15:37,334 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1689185736889.5ac33830d086b3a7de54a793dff578ae., pid=60, masterSystemTime=1689185737297 2023-07-12 18:15:37,335 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1689185736889.4f7f7d9d9128a95660641bdd0b71a19c., pid=61, masterSystemTime=1689185737297 2023-07-12 18:15:37,339 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1689185736889.5ac33830d086b3a7de54a793dff578ae. 2023-07-12 18:15:37,339 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1689185736889.5ac33830d086b3a7de54a793dff578ae. 2023-07-12 18:15:37,339 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=5ac33830d086b3a7de54a793dff578ae, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:15:37,340 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689185736889.5ac33830d086b3a7de54a793dff578ae.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689185737339"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689185737339"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689185737339"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689185737339"}]},"ts":"1689185737339"} 2023-07-12 18:15:37,340 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=4f7f7d9d9128a95660641bdd0b71a19c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:15:37,340 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689185736889.4f7f7d9d9128a95660641bdd0b71a19c.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689185737340"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689185737340"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689185737340"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689185737340"}]},"ts":"1689185737340"} 2023-07-12 18:15:37,350 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1689185736889.4f7f7d9d9128a95660641bdd0b71a19c. 2023-07-12 18:15:37,350 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1689185736889.4f7f7d9d9128a95660641bdd0b71a19c. 2023-07-12 18:15:37,350 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=59 2023-07-12 18:15:37,350 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=58 2023-07-12 18:15:37,351 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=59, state=SUCCESS; OpenRegionProcedure 5ac33830d086b3a7de54a793dff578ae, server=jenkins-hbase4.apache.org,34493,1689185653159 in 200 msec 2023-07-12 18:15:37,351 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=58, state=SUCCESS; OpenRegionProcedure 4f7f7d9d9128a95660641bdd0b71a19c, server=jenkins-hbase4.apache.org,34205,1689185653087 in 200 msec 2023-07-12 18:15:37,356 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=4f7f7d9d9128a95660641bdd0b71a19c, ASSIGN in 369 msec 2023-07-12 18:15:37,357 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=59, resume processing ppid=57 2023-07-12 18:15:37,357 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=5ac33830d086b3a7de54a793dff578ae, ASSIGN in 369 msec 2023-07-12 18:15:37,358 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 18:15:37,358 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689185737358"}]},"ts":"1689185737358"} 2023-07-12 18:15:37,360 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-07-12 18:15:37,362 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 18:15:37,363 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-07-12 18:15:37,365 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34493] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-12 18:15:37,367 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 18:15:37,367 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 18:15:37,367 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 18:15:37,367 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 18:15:37,371 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 18:15:37,371 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 18:15:37,371 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 18:15:37,371 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 18:15:37,373 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 480 msec 2023-07-12 18:15:37,504 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-12 18:15:37,504 INFO [Listener at jenkins-hbase4.apache.org/41393] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-07-12 18:15:37,509 DEBUG [Listener at jenkins-hbase4.apache.org/41393] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:37,509 DEBUG [Listener at jenkins-hbase4.apache.org/41393] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1689185736889.4f7f7d9d9128a95660641bdd0b71a19c. 2023-07-12 18:15:37,511 INFO [Listener at jenkins-hbase4.apache.org/41393] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 18:15:37,550 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-12 18:15:37,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689185737550 (current time:1689185737550). 2023-07-12 18:15:37,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 18:15:37,551 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] zookeeper.ReadOnlyZKClient(139): Connect 0x2bfd0e5e to 127.0.0.1:62122 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 18:15:37,565 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6d9c97d9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 18:15:37,566 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 18:15:37,568 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50754, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 18:15:37,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2bfd0e5e to 127.0.0.1:62122 2023-07-12 18:15:37,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 18:15:37,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] zookeeper.ReadOnlyZKClient(139): Connect 0x389463ac to 127.0.0.1:62122 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 18:15:37,581 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7bd8051e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 18:15:37,586 DEBUG [hconnection-0x727377e3-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 18:15:37,589 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50760, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 18:15:37,598 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x389463ac to 127.0.0.1:62122 2023-07-12 18:15:37,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 18:15:37,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-12 18:15:37,600 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 18:15:37,600 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-12 18:15:37,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] procedure2.ProcedureExecutor(1029): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-12 18:15:37,605 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-12 18:15:37,606 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689186337606 2023-07-12 18:15:37,606 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:37,606 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-12 18:15:37,608 DEBUG [Listener at jenkins-hbase4.apache.org/41393] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 18:15:37,608 DEBUG [Listener at jenkins-hbase4.apache.org/41393] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 18:15:37,609 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-12 18:15:37,609 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-12 18:15:37,611 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 8 msec 2023-07-12 18:15:37,612 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-12 18:15:37,613 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689186337613 2023-07-12 18:15:37,630 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:37,630 INFO [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-12 18:15:37,630 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 18:15:37,632 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-12 18:15:37,632 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-12 18:15:37,701 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:37,701 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:37,704 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:15:37,705 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:15:37,705 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:15:37,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:15:37,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:37,706 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:15:37,706 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:15:37,706 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:15:37,706 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:37,706 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:15:37,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:15:37,706 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:15:37,706 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:15:37,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:15:37,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:37,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:37,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-12 18:15:37,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:37,707 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-12 18:15:37,707 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:37,707 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:37,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-12 18:15:37,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:37,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-12 18:15:37,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:37,708 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-12 18:15:37,708 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-12 18:15:37,709 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:37,709 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:15:37,709 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-12 18:15:37,709 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 18:15:37,709 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:37,709 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 18:15:37,709 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-12 18:15:37,711 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:37,711 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-12 18:15:37,711 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 18:15:37,710 DEBUG [Listener at jenkins-hbase4.apache.org/41393] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 18:15:37,711 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 18:15:37,710 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-12 18:15:37,712 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-12 18:15:37,715 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-12 18:15:37,715 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34493,1689185653159' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-12 18:15:37,715 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-12 18:15:37,713 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-12 18:15:37,715 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-12 18:15:37,714 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-12 18:15:37,716 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-12 18:15:37,716 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37689,1689185653014' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-12 18:15:37,716 DEBUG [Listener at jenkins-hbase4.apache.org/41393] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 18:15:37,715 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34205,1689185653087' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-12 18:15:37,717 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:15:37,717 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:37,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:15:37,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 18:15:37,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 18:15:37,717 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:37,717 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 18:15:37,719 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:37,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 18:15:37,719 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:15:37,719 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:37,719 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:37,719 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 18:15:37,720 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:37,720 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 18:15:37,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 18:15:37,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:37,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:15:37,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:15:37,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:15:37,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 18:15:37,725 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34493,1689185653159' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-12 18:15:37,726 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5a26d244[Count = 1] remaining members to acquire global barrier 2023-07-12 18:15:37,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:15:37,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 18:15:37,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 18:15:37,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 18:15:37,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 18:15:37,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:37,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:15:37,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:15:37,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:15:37,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 18:15:37,729 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34205,1689185653087' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-12 18:15:37,730 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5a26d244[Count = 0] remaining members to acquire global barrier 2023-07-12 18:15:37,730 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-12 18:15:37,730 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:37,731 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:37,731 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:37,731 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:37,731 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:37,731 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:37,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:37,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:37,731 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:15:37,731 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-12 18:15:37,731 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:37,731 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-12 18:15:37,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:37,732 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-12 18:15:37,732 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,37689,1689185653014' in zk 2023-07-12 18:15:37,732 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-12 18:15:37,732 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:15:37,732 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 18:15:37,732 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 18:15:37,733 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 18:15:37,733 DEBUG [rs(jenkins-hbase4.apache.org,34205,1689185653087)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689185736889.4f7f7d9d9128a95660641bdd0b71a19c. 2023-07-12 18:15:37,733 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 18:15:37,733 DEBUG [rs(jenkins-hbase4.apache.org,34493,1689185653159)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689185736889.5ac33830d086b3a7de54a793dff578ae. 2023-07-12 18:15:37,733 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 18:15:37,733 DEBUG [rs(jenkins-hbase4.apache.org,34205,1689185653087)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689185736889.4f7f7d9d9128a95660641bdd0b71a19c. started... 2023-07-12 18:15:37,733 DEBUG [rs(jenkins-hbase4.apache.org,34493,1689185653159)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689185736889.5ac33830d086b3a7de54a793dff578ae. started... 2023-07-12 18:15:37,733 DEBUG [rs(jenkins-hbase4.apache.org,34205,1689185653087)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4f7f7d9d9128a95660641bdd0b71a19c: 2023-07-12 18:15:37,735 DEBUG [rs(jenkins-hbase4.apache.org,34493,1689185653159)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5ac33830d086b3a7de54a793dff578ae: 2023-07-12 18:15:37,735 DEBUG [rs(jenkins-hbase4.apache.org,34205,1689185653087)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689185736889.4f7f7d9d9128a95660641bdd0b71a19c.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:37,735 DEBUG [rs(jenkins-hbase4.apache.org,34493,1689185653159)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689185736889.5ac33830d086b3a7de54a793dff578ae.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:37,735 DEBUG [rs(jenkins-hbase4.apache.org,34205,1689185653087)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 18:15:37,735 DEBUG [rs(jenkins-hbase4.apache.org,34205,1689185653087)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 18:15:37,735 DEBUG [rs(jenkins-hbase4.apache.org,34493,1689185653159)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 18:15:37,735 DEBUG [rs(jenkins-hbase4.apache.org,34493,1689185653159)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 18:15:37,743 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-12 18:15:37,743 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 18:15:37,743 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-12 18:15:37,791 DEBUG [rs(jenkins-hbase4.apache.org,34205,1689185653087)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689185736889.4f7f7d9d9128a95660641bdd0b71a19c. completed. 2023-07-12 18:15:37,791 DEBUG [rs(jenkins-hbase4.apache.org,34205,1689185653087)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689185736889.4f7f7d9d9128a95660641bdd0b71a19c. 2023-07-12 18:15:37,791 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 18:15:37,791 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 18:15:37,791 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:15:37,801 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-12 18:15:37,801 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,34205,1689185653087' in zk 2023-07-12 18:15:37,803 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-12 18:15:37,803 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:15:37,803 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 18:15:37,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:15:37,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 18:15:37,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 18:15:37,804 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-12 18:15:37,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 18:15:37,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 18:15:37,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:37,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:15:37,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:15:37,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:15:37,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 18:15:37,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:37,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:15:37,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:15:37,817 DEBUG [rs(jenkins-hbase4.apache.org,34493,1689185653159)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689185736889.5ac33830d086b3a7de54a793dff578ae. completed. 2023-07-12 18:15:37,817 DEBUG [rs(jenkins-hbase4.apache.org,34493,1689185653159)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689185736889.5ac33830d086b3a7de54a793dff578ae. 2023-07-12 18:15:37,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,34205,1689185653087': 2023-07-12 18:15:37,817 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 18:15:37,817 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 18:15:37,817 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:15:37,817 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34205,1689185653087' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-12 18:15:37,817 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-12 18:15:37,817 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,34493,1689185653159' in zk 2023-07-12 18:15:37,823 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:15:37,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:15:37,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 18:15:37,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 18:15:37,824 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-12 18:15:37,824 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 18:15:37,824 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-12 18:15:37,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 18:15:37,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 18:15:37,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:37,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:15:37,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:15:37,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:15:37,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 18:15:37,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:37,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:15:37,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:15:37,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:15:37,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,34493,1689185653159': 2023-07-12 18:15:37,834 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34493,1689185653159' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-12 18:15:37,834 INFO [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-12 18:15:37,834 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 18:15:37,834 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 18:15:37,834 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:37,834 INFO [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 18:15:37,836 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:37,836 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:37,836 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:15:37,836 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:37,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:37,836 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:15:37,836 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:37,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:37,836 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:37,836 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:15:37,837 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:37,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:37,836 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:37,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:37,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 18:15:37,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 18:15:37,837 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:15:37,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:15:37,837 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:15:37,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:15:37,837 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:15:37,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:15:37,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:37,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:37,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:37,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 18:15:37,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:37,838 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:15:37,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 18:15:37,839 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:15:37,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:37,840 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:15:37,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:15:37,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:15:37,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:15:37,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 18:15:37,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:37,842 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:15:37,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:15:37,842 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:15:37,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:15:37,843 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:15:37,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:15:37,848 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:15:37,848 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:37,848 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:15:37,848 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:15:37,848 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:37,849 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:15:37,849 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 18:15:37,849 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:15:37,848 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:15:37,848 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:15:37,851 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:15:37,851 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:15:37,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:15:37,849 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:37,849 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:15:37,849 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:15:37,851 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:37,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:15:37,851 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:15:37,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:15:37,851 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:15:37,851 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:37,852 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-12 18:15:37,851 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:37,852 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:15:37,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:15:37,852 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:15:37,852 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:15:37,852 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:15:37,852 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:37,852 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:37,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:15:37,853 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:15:37,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:15:37,853 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-12 18:15:37,885 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:37,885 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:37,916 DEBUG [Listener at jenkins-hbase4.apache.org/41393] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 18:15:37,919 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-12 18:15:37,919 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-12 18:15:37,920 DEBUG [Listener at jenkins-hbase4.apache.org/41393] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-12 18:15:37,931 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:37,967 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-12 18:15:37,967 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:37,967 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:37,967 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689185737606Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1689185737884 (+278 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689185737885 (+1 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689185737885Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689185737896 (+11 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689185737921 (+25 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689185737967 (+46 ms) 2023-07-12 18:15:37,970 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-12 18:15:37,973 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 363 msec 2023-07-12 18:15:38,220 DEBUG [Listener at jenkins-hbase4.apache.org/41393] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 18:15:38,223 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-12 18:15:38,223 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 18:15:38,226 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34205] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1689185736889.4f7f7d9d9128a95660641bdd0b71a19c. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 18:15:38,227 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34493] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1689185736889.5ac33830d086b3a7de54a793dff578ae. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 18:15:38,232 DEBUG [Listener at jenkins-hbase4.apache.org/41393] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:38,233 DEBUG [Listener at jenkins-hbase4.apache.org/41393] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1689185736889.4f7f7d9d9128a95660641bdd0b71a19c. 2023-07-12 18:15:38,233 INFO [Listener at jenkins-hbase4.apache.org/41393] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 18:15:38,246 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-12 18:15:38,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689185738246 (current time:1689185738246). 2023-07-12 18:15:38,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 18:15:38,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] zookeeper.ReadOnlyZKClient(139): Connect 0x54bdc1bd to 127.0.0.1:62122 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 18:15:38,288 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@46a38e47, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 18:15:38,290 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 18:15:38,295 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50762, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 18:15:38,298 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x54bdc1bd to 127.0.0.1:62122 2023-07-12 18:15:38,298 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 18:15:38,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] zookeeper.ReadOnlyZKClient(139): Connect 0x25a272c2 to 127.0.0.1:62122 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 18:15:38,343 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1fa8efe2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 18:15:38,406 DEBUG [hconnection-0x45a39be6-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 18:15:38,407 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50766, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 18:15:38,419 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x25a272c2 to 127.0.0.1:62122 2023-07-12 18:15:38,420 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 18:15:38,420 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-12 18:15:38,425 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 18:15:38,425 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-12 18:15:38,434 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-12 18:15:38,436 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-12 18:15:38,440 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689186338440 2023-07-12 18:15:38,440 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-12 18:15:38,440 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:38,441 DEBUG [Listener at jenkins-hbase4.apache.org/41393] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 18:15:38,441 DEBUG [Listener at jenkins-hbase4.apache.org/41393] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 18:15:38,450 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-12 18:15:38,455 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-12 18:15:38,462 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 24 msec 2023-07-12 18:15:38,464 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-12 18:15:38,465 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689186338465 2023-07-12 18:15:38,518 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:38,519 INFO [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-12 18:15:38,519 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 18:15:38,521 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-12 18:15:38,521 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-12 18:15:38,521 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:38,521 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:38,524 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:15:38,524 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:15:38,524 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:15:38,524 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:15:38,524 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:15:38,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:15:38,524 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:15:38,524 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:15:38,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:15:38,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:15:38,525 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:15:38,525 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:15:38,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:38,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:38,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:38,526 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:38,526 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:38,526 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:38,526 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:15:38,526 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 18:15:38,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-12 18:15:38,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:38,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-12 18:15:38,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:38,527 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-12 18:15:38,527 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-12 18:15:38,527 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:38,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-12 18:15:38,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:38,527 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-12 18:15:38,527 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 18:15:38,527 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-12 18:15:38,528 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:38,528 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:38,528 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-12 18:15:38,528 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-12 18:15:38,536 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 18:15:38,536 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-12 18:15:38,537 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-12 18:15:38,538 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-12 18:15:38,536 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 18:15:38,538 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34205,1689185653087' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-12 18:15:38,539 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-12 18:15:38,539 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-12 18:15:38,537 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-12 18:15:38,539 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37689,1689185653014' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-12 18:15:38,539 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34493,1689185653159' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-12 18:15:38,541 DEBUG [Listener at jenkins-hbase4.apache.org/41393] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 18:15:38,542 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:15:38,542 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:38,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:15:38,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 18:15:38,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 18:15:38,542 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:38,542 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:38,542 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 18:15:38,542 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:15:38,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 18:15:38,543 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:38,543 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 18:15:38,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 18:15:38,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:38,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:15:38,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:15:38,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:15:38,544 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:38,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 18:15:38,545 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-12 18:15:38,545 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-12 18:15:38,545 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:38,545 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34205,1689185653087' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-12 18:15:38,545 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 18:15:38,545 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@753105f4[Count = 1] remaining members to acquire global barrier 2023-07-12 18:15:38,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:15:38,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 18:15:38,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 18:15:38,545 DEBUG [Listener at jenkins-hbase4.apache.org/41393] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 18:15:38,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 18:15:38,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 18:15:38,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:38,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:15:38,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:15:38,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:15:38,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 18:15:38,547 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34493,1689185653159' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-12 18:15:38,548 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@753105f4[Count = 0] remaining members to acquire global barrier 2023-07-12 18:15:38,548 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-12 18:15:38,548 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:38,549 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:38,549 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:38,549 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:38,549 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:38,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:38,549 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:38,549 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-12 18:15:38,549 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:38,549 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:15:38,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:38,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:38,550 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-12 18:15:38,550 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-12 18:15:38,550 DEBUG [rs(jenkins-hbase4.apache.org,34205,1689185653087)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689185736889.4f7f7d9d9128a95660641bdd0b71a19c. 2023-07-12 18:15:38,550 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-12 18:15:38,550 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,37689,1689185653014' in zk 2023-07-12 18:15:38,550 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 18:15:38,550 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:15:38,550 DEBUG [rs(jenkins-hbase4.apache.org,34493,1689185653159)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689185736889.5ac33830d086b3a7de54a793dff578ae. 2023-07-12 18:15:38,550 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 18:15:38,550 DEBUG [rs(jenkins-hbase4.apache.org,34493,1689185653159)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689185736889.5ac33830d086b3a7de54a793dff578ae. started... 2023-07-12 18:15:38,550 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 18:15:38,550 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 18:15:38,550 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 18:15:38,551 INFO [rs(jenkins-hbase4.apache.org,34493,1689185653159)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 5ac33830d086b3a7de54a793dff578ae 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-07-12 18:15:38,550 DEBUG [rs(jenkins-hbase4.apache.org,34205,1689185653087)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689185736889.4f7f7d9d9128a95660641bdd0b71a19c. started... 2023-07-12 18:15:38,551 INFO [rs(jenkins-hbase4.apache.org,34205,1689185653087)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 4f7f7d9d9128a95660641bdd0b71a19c 1/1 column families, dataSize=132 B heapSize=544 B 2023-07-12 18:15:38,552 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-12 18:15:38,552 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 18:15:38,552 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-12 18:15:38,575 INFO [rs(jenkins-hbase4.apache.org,34205,1689185653087)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307121a30bccba60b4f08a35b79a7a5012e44 to hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202307121a30bccba60b4f08a35b79a7a5012e44 2023-07-12 18:15:38,575 INFO [rs(jenkins-hbase4.apache.org,34493,1689185653159)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230712ec1205ce14494afb8ebef5fc02322d0c to hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230712ec1205ce14494afb8ebef5fc02322d0c 2023-07-12 18:15:38,595 INFO [rs(jenkins-hbase4.apache.org,34205,1689185653087)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testExportFileSystemStateWithMergeRegion/4f7f7d9d9128a95660641bdd0b71a19c/.tmp/cf/42e49ecb44c84755a7d947280eeb65df 2023-07-12 18:15:38,600 INFO [rs(jenkins-hbase4.apache.org,34493,1689185653159)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testExportFileSystemStateWithMergeRegion/5ac33830d086b3a7de54a793dff578ae/.tmp/cf/856bed47d5d04eafa291081fc4d4e4c6 2023-07-12 18:15:38,601 DEBUG [rs(jenkins-hbase4.apache.org,34205,1689185653087)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testExportFileSystemStateWithMergeRegion/4f7f7d9d9128a95660641bdd0b71a19c/.tmp/cf/42e49ecb44c84755a7d947280eeb65df as hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testExportFileSystemStateWithMergeRegion/4f7f7d9d9128a95660641bdd0b71a19c/cf/42e49ecb44c84755a7d947280eeb65df 2023-07-12 18:15:38,606 DEBUG [rs(jenkins-hbase4.apache.org,34493,1689185653159)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testExportFileSystemStateWithMergeRegion/5ac33830d086b3a7de54a793dff578ae/.tmp/cf/856bed47d5d04eafa291081fc4d4e4c6 as hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testExportFileSystemStateWithMergeRegion/5ac33830d086b3a7de54a793dff578ae/cf/856bed47d5d04eafa291081fc4d4e4c6 2023-07-12 18:15:38,607 INFO [rs(jenkins-hbase4.apache.org,34205,1689185653087)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testExportFileSystemStateWithMergeRegion/4f7f7d9d9128a95660641bdd0b71a19c/cf/42e49ecb44c84755a7d947280eeb65df, entries=2, sequenceid=6, filesize=5.3 K 2023-07-12 18:15:38,614 INFO [rs(jenkins-hbase4.apache.org,34205,1689185653087)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for 4f7f7d9d9128a95660641bdd0b71a19c in 63ms, sequenceid=6, compaction requested=false 2023-07-12 18:15:38,614 DEBUG [rs(jenkins-hbase4.apache.org,34205,1689185653087)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-07-12 18:15:38,614 DEBUG [rs(jenkins-hbase4.apache.org,34205,1689185653087)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4f7f7d9d9128a95660641bdd0b71a19c: 2023-07-12 18:15:38,615 DEBUG [rs(jenkins-hbase4.apache.org,34205,1689185653087)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689185736889.4f7f7d9d9128a95660641bdd0b71a19c.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:38,615 DEBUG [rs(jenkins-hbase4.apache.org,34205,1689185653087)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 18:15:38,615 DEBUG [rs(jenkins-hbase4.apache.org,34205,1689185653087)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testExportFileSystemStateWithMergeRegion/4f7f7d9d9128a95660641bdd0b71a19c/cf/42e49ecb44c84755a7d947280eeb65df] hfiles 2023-07-12 18:15:38,615 DEBUG [rs(jenkins-hbase4.apache.org,34205,1689185653087)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testExportFileSystemStateWithMergeRegion/4f7f7d9d9128a95660641bdd0b71a19c/cf/42e49ecb44c84755a7d947280eeb65df for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:38,620 INFO [rs(jenkins-hbase4.apache.org,34493,1689185653159)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testExportFileSystemStateWithMergeRegion/5ac33830d086b3a7de54a793dff578ae/cf/856bed47d5d04eafa291081fc4d4e4c6, entries=48, sequenceid=6, filesize=13.7 K 2023-07-12 18:15:38,621 INFO [rs(jenkins-hbase4.apache.org,34493,1689185653159)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for 5ac33830d086b3a7de54a793dff578ae in 70ms, sequenceid=6, compaction requested=false 2023-07-12 18:15:38,622 DEBUG [rs(jenkins-hbase4.apache.org,34493,1689185653159)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5ac33830d086b3a7de54a793dff578ae: 2023-07-12 18:15:38,622 DEBUG [rs(jenkins-hbase4.apache.org,34493,1689185653159)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689185736889.5ac33830d086b3a7de54a793dff578ae.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:38,622 DEBUG [rs(jenkins-hbase4.apache.org,34493,1689185653159)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 18:15:38,622 DEBUG [rs(jenkins-hbase4.apache.org,34493,1689185653159)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testExportFileSystemStateWithMergeRegion/5ac33830d086b3a7de54a793dff578ae/cf/856bed47d5d04eafa291081fc4d4e4c6] hfiles 2023-07-12 18:15:38,622 DEBUG [rs(jenkins-hbase4.apache.org,34493,1689185653159)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testExportFileSystemStateWithMergeRegion/5ac33830d086b3a7de54a793dff578ae/cf/856bed47d5d04eafa291081fc4d4e4c6 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:38,647 DEBUG [rs(jenkins-hbase4.apache.org,34205,1689185653087)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689185736889.4f7f7d9d9128a95660641bdd0b71a19c. completed. 2023-07-12 18:15:38,647 DEBUG [rs(jenkins-hbase4.apache.org,34205,1689185653087)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689185736889.4f7f7d9d9128a95660641bdd0b71a19c. 2023-07-12 18:15:38,648 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 18:15:38,648 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 18:15:38,648 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:15:38,648 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-12 18:15:38,648 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,34205,1689185653087' in zk 2023-07-12 18:15:38,650 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:15:38,650 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-12 18:15:38,650 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 18:15:38,650 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-12 18:15:38,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:15:38,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 18:15:38,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 18:15:38,656 DEBUG [rs(jenkins-hbase4.apache.org,34493,1689185653159)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689185736889.5ac33830d086b3a7de54a793dff578ae. completed. 2023-07-12 18:15:38,656 DEBUG [rs(jenkins-hbase4.apache.org,34493,1689185653159)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689185736889.5ac33830d086b3a7de54a793dff578ae. 2023-07-12 18:15:38,656 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 18:15:38,656 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 18:15:38,656 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:15:38,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 18:15:38,656 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-12 18:15:38,656 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,34493,1689185653159' in zk 2023-07-12 18:15:38,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 18:15:38,659 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-12 18:15:38,659 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:15:38,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:38,659 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 18:15:38,660 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-12 18:15:38,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:15:38,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:15:38,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:15:38,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 18:15:38,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:38,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:15:38,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:15:38,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:15:38,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,34205,1689185653087': 2023-07-12 18:15:38,665 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34205,1689185653087' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-12 18:15:38,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:15:38,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 18:15:38,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 18:15:38,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 18:15:38,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 18:15:38,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:38,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:15:38,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:15:38,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:15:38,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 18:15:38,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:38,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:15:38,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:15:38,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:15:38,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,34493,1689185653159': 2023-07-12 18:15:38,670 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34493,1689185653159' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-12 18:15:38,670 INFO [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-12 18:15:38,670 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 18:15:38,670 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 18:15:38,670 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:38,670 INFO [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 18:15:38,676 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:38,676 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:38,676 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:15:38,676 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:38,676 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:38,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:38,676 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:38,676 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:15:38,676 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:38,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:38,676 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:15:38,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:15:38,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:38,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 18:15:38,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 18:15:38,676 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:38,676 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:15:38,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:38,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 18:15:38,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:38,679 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:15:38,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:15:38,679 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:15:38,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:15:38,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:38,680 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:15:38,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:38,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:38,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 18:15:38,680 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:15:38,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:38,681 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:15:38,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:15:38,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:15:38,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:15:38,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 18:15:38,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:38,684 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:15:38,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:15:38,684 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:15:38,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:15:38,685 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:15:38,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:15:38,695 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:15:38,695 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:15:38,695 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:15:38,695 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:15:38,695 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 18:15:38,695 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:15:38,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:15:38,695 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:15:38,695 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:38,695 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:38,695 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:15:38,695 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:15:38,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:15:38,695 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:15:38,696 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:38,696 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:15:38,696 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:38,696 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:15:38,696 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:15:38,696 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:38,696 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:38,695 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:38,696 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:38,696 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-12 18:15:38,696 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:15:38,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:15:38,696 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:15:38,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:15:38,697 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230712ec1205ce14494afb8ebef5fc02322d0c, hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202307121a30bccba60b4f08a35b79a7a5012e44] mob files 2023-07-12 18:15:38,697 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230712ec1205ce14494afb8ebef5fc02322d0c 2023-07-12 18:15:38,697 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202307121a30bccba60b4f08a35b79a7a5012e44 2023-07-12 18:15:38,698 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:15:38,701 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:15:38,701 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:15:38,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:15:38,702 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:15:38,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:15:38,715 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:38,715 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:38,745 DEBUG [Listener at jenkins-hbase4.apache.org/41393] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 18:15:38,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-12 18:15:38,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-12 18:15:38,747 DEBUG [Listener at jenkins-hbase4.apache.org/41393] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-12 18:15:38,753 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:38,798 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-12 18:15:38,798 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:38,799 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:38,799 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689185738440Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1689185738714 (+274 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689185738714Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1689185738715 (+1 ms)Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1689185738722 (+7 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689185738741 (+19 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689185738798 (+57 ms) 2023-07-12 18:15:38,801 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-12 18:15:38,803 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 353 msec 2023-07-12 18:15:39,047 DEBUG [Listener at jenkins-hbase4.apache.org/41393] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 18:15:39,048 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-12 18:15:39,048 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 18:15:39,083 DEBUG [Listener at jenkins-hbase4.apache.org/41393] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-12 18:15:39,092 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56180, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-12 18:15:39,095 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34205] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-12 18:15:39,096 DEBUG [Listener at jenkins-hbase4.apache.org/41393] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-12 18:15:39,103 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50770, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-12 18:15:39,104 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34493] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-12 18:15:39,105 DEBUG [Listener at jenkins-hbase4.apache.org/41393] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-12 18:15:39,111 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53796, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-12 18:15:39,111 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37689] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-12 18:15:39,113 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-12 18:15:39,115 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] procedure2.ProcedureExecutor(1029): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:39,117 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 18:15:39,117 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-07-12 18:15:39,119 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 18:15:39,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-12 18:15:39,122 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c8ffc4162cfabd16f3963b8add2d91f4 2023-07-12 18:15:39,122 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0106020e93799dbdff7abee4b408b831 2023-07-12 18:15:39,123 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0106020e93799dbdff7abee4b408b831 empty. 2023-07-12 18:15:39,124 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c8ffc4162cfabd16f3963b8add2d91f4 empty. 2023-07-12 18:15:39,124 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0106020e93799dbdff7abee4b408b831 2023-07-12 18:15:39,124 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c8ffc4162cfabd16f3963b8add2d91f4 2023-07-12 18:15:39,125 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-12 18:15:39,137 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-07-12 18:15:39,139 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => c8ffc4162cfabd16f3963b8add2d91f4, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689185739113.c8ffc4162cfabd16f3963b8add2d91f4.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp 2023-07-12 18:15:39,139 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => 0106020e93799dbdff7abee4b408b831, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689185739113.0106020e93799dbdff7abee4b408b831.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp 2023-07-12 18:15:39,165 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689185739113.c8ffc4162cfabd16f3963b8add2d91f4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 18:15:39,166 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing c8ffc4162cfabd16f3963b8add2d91f4, disabling compactions & flushes 2023-07-12 18:15:39,166 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689185739113.c8ffc4162cfabd16f3963b8add2d91f4. 2023-07-12 18:15:39,166 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689185739113.c8ffc4162cfabd16f3963b8add2d91f4. 2023-07-12 18:15:39,166 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689185739113.c8ffc4162cfabd16f3963b8add2d91f4. after waiting 0 ms 2023-07-12 18:15:39,166 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689185739113.c8ffc4162cfabd16f3963b8add2d91f4. 2023-07-12 18:15:39,166 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689185739113.0106020e93799dbdff7abee4b408b831.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 18:15:39,166 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689185739113.c8ffc4162cfabd16f3963b8add2d91f4. 2023-07-12 18:15:39,166 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing 0106020e93799dbdff7abee4b408b831, disabling compactions & flushes 2023-07-12 18:15:39,166 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for c8ffc4162cfabd16f3963b8add2d91f4: 2023-07-12 18:15:39,166 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689185739113.0106020e93799dbdff7abee4b408b831. 2023-07-12 18:15:39,166 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689185739113.0106020e93799dbdff7abee4b408b831. 2023-07-12 18:15:39,166 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689185739113.0106020e93799dbdff7abee4b408b831. after waiting 0 ms 2023-07-12 18:15:39,166 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689185739113.0106020e93799dbdff7abee4b408b831. 2023-07-12 18:15:39,166 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689185739113.0106020e93799dbdff7abee4b408b831. 2023-07-12 18:15:39,166 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for 0106020e93799dbdff7abee4b408b831: 2023-07-12 18:15:39,171 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 18:15:39,172 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689185739113.c8ffc4162cfabd16f3963b8add2d91f4.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689185739172"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689185739172"}]},"ts":"1689185739172"} 2023-07-12 18:15:39,173 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689185739113.0106020e93799dbdff7abee4b408b831.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689185739172"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689185739172"}]},"ts":"1689185739172"} 2023-07-12 18:15:39,175 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-12 18:15:39,175 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 18:15:39,176 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689185739176"}]},"ts":"1689185739176"} 2023-07-12 18:15:39,177 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-07-12 18:15:39,182 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-12 18:15:39,184 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 18:15:39,185 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 18:15:39,185 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-12 18:15:39,185 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 18:15:39,185 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=c8ffc4162cfabd16f3963b8add2d91f4, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=0106020e93799dbdff7abee4b408b831, ASSIGN}] 2023-07-12 18:15:39,191 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=0106020e93799dbdff7abee4b408b831, ASSIGN 2023-07-12 18:15:39,191 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=c8ffc4162cfabd16f3963b8add2d91f4, ASSIGN 2023-07-12 18:15:39,192 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=0106020e93799dbdff7abee4b408b831, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34493,1689185653159; forceNewPlan=false, retain=false 2023-07-12 18:15:39,192 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=c8ffc4162cfabd16f3963b8add2d91f4, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34205,1689185653087; forceNewPlan=false, retain=false 2023-07-12 18:15:39,225 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-12 18:15:39,342 INFO [jenkins-hbase4:43177] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-12 18:15:39,345 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=c8ffc4162cfabd16f3963b8add2d91f4, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:15:39,345 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=0106020e93799dbdff7abee4b408b831, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:15:39,346 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689185739113.c8ffc4162cfabd16f3963b8add2d91f4.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689185739345"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689185739345"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689185739345"}]},"ts":"1689185739345"} 2023-07-12 18:15:39,346 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689185739113.0106020e93799dbdff7abee4b408b831.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689185739345"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689185739345"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689185739345"}]},"ts":"1689185739345"} 2023-07-12 18:15:39,348 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure c8ffc4162cfabd16f3963b8add2d91f4, server=jenkins-hbase4.apache.org,34205,1689185653087}] 2023-07-12 18:15:39,349 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=70, ppid=68, state=RUNNABLE; OpenRegionProcedure 0106020e93799dbdff7abee4b408b831, server=jenkins-hbase4.apache.org,34493,1689185653159}] 2023-07-12 18:15:39,426 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-12 18:15:39,505 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1689185739113.0106020e93799dbdff7abee4b408b831. 2023-07-12 18:15:39,505 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0106020e93799dbdff7abee4b408b831, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689185739113.0106020e93799dbdff7abee4b408b831.', STARTKEY => '2', ENDKEY => ''} 2023-07-12 18:15:39,506 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1689185739113.0106020e93799dbdff7abee4b408b831. service=AccessControlService 2023-07-12 18:15:39,506 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 18:15:39,506 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 0106020e93799dbdff7abee4b408b831 2023-07-12 18:15:39,506 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689185739113.0106020e93799dbdff7abee4b408b831.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 18:15:39,506 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 0106020e93799dbdff7abee4b408b831 2023-07-12 18:15:39,506 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 0106020e93799dbdff7abee4b408b831 2023-07-12 18:15:39,508 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689185739113.c8ffc4162cfabd16f3963b8add2d91f4. 2023-07-12 18:15:39,509 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c8ffc4162cfabd16f3963b8add2d91f4, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689185739113.c8ffc4162cfabd16f3963b8add2d91f4.', STARTKEY => '', ENDKEY => '2'} 2023-07-12 18:15:39,509 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689185739113.c8ffc4162cfabd16f3963b8add2d91f4. service=AccessControlService 2023-07-12 18:15:39,509 INFO [StoreOpener-0106020e93799dbdff7abee4b408b831-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 0106020e93799dbdff7abee4b408b831 2023-07-12 18:15:39,509 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 18:15:39,509 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 c8ffc4162cfabd16f3963b8add2d91f4 2023-07-12 18:15:39,509 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689185739113.c8ffc4162cfabd16f3963b8add2d91f4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 18:15:39,509 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c8ffc4162cfabd16f3963b8add2d91f4 2023-07-12 18:15:39,509 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c8ffc4162cfabd16f3963b8add2d91f4 2023-07-12 18:15:39,512 INFO [StoreOpener-c8ffc4162cfabd16f3963b8add2d91f4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region c8ffc4162cfabd16f3963b8add2d91f4 2023-07-12 18:15:39,513 DEBUG [StoreOpener-0106020e93799dbdff7abee4b408b831-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0106020e93799dbdff7abee4b408b831/cf 2023-07-12 18:15:39,514 DEBUG [StoreOpener-c8ffc4162cfabd16f3963b8add2d91f4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c8ffc4162cfabd16f3963b8add2d91f4/cf 2023-07-12 18:15:39,516 DEBUG [StoreOpener-0106020e93799dbdff7abee4b408b831-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0106020e93799dbdff7abee4b408b831/cf 2023-07-12 18:15:39,516 DEBUG [StoreOpener-c8ffc4162cfabd16f3963b8add2d91f4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c8ffc4162cfabd16f3963b8add2d91f4/cf 2023-07-12 18:15:39,517 INFO [StoreOpener-0106020e93799dbdff7abee4b408b831-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0106020e93799dbdff7abee4b408b831 columnFamilyName cf 2023-07-12 18:15:39,517 INFO [StoreOpener-c8ffc4162cfabd16f3963b8add2d91f4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c8ffc4162cfabd16f3963b8add2d91f4 columnFamilyName cf 2023-07-12 18:15:39,518 INFO [StoreOpener-0106020e93799dbdff7abee4b408b831-1] regionserver.HStore(310): Store=0106020e93799dbdff7abee4b408b831/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 18:15:39,518 INFO [StoreOpener-c8ffc4162cfabd16f3963b8add2d91f4-1] regionserver.HStore(310): Store=c8ffc4162cfabd16f3963b8add2d91f4/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 18:15:39,520 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c8ffc4162cfabd16f3963b8add2d91f4 2023-07-12 18:15:39,520 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0106020e93799dbdff7abee4b408b831 2023-07-12 18:15:39,521 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c8ffc4162cfabd16f3963b8add2d91f4 2023-07-12 18:15:39,521 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0106020e93799dbdff7abee4b408b831 2023-07-12 18:15:39,525 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c8ffc4162cfabd16f3963b8add2d91f4 2023-07-12 18:15:39,525 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 0106020e93799dbdff7abee4b408b831 2023-07-12 18:15:39,528 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c8ffc4162cfabd16f3963b8add2d91f4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 18:15:39,529 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0106020e93799dbdff7abee4b408b831/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 18:15:39,529 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c8ffc4162cfabd16f3963b8add2d91f4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71207346, jitterRate=0.06107214093208313}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 18:15:39,529 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 0106020e93799dbdff7abee4b408b831; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65036638, jitterRate=-0.030878573656082153}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 18:15:39,529 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c8ffc4162cfabd16f3963b8add2d91f4: 2023-07-12 18:15:39,529 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 0106020e93799dbdff7abee4b408b831: 2023-07-12 18:15:39,530 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689185739113.0106020e93799dbdff7abee4b408b831., pid=70, masterSystemTime=1689185739501 2023-07-12 18:15:39,530 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689185739113.c8ffc4162cfabd16f3963b8add2d91f4., pid=69, masterSystemTime=1689185739501 2023-07-12 18:15:39,534 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689185739113.c8ffc4162cfabd16f3963b8add2d91f4. 2023-07-12 18:15:39,534 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689185739113.c8ffc4162cfabd16f3963b8add2d91f4. 2023-07-12 18:15:39,534 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=c8ffc4162cfabd16f3963b8add2d91f4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:15:39,534 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689185739113.0106020e93799dbdff7abee4b408b831. 2023-07-12 18:15:39,534 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689185739113.c8ffc4162cfabd16f3963b8add2d91f4.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689185739534"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689185739534"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689185739534"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689185739534"}]},"ts":"1689185739534"} 2023-07-12 18:15:39,534 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1689185739113.0106020e93799dbdff7abee4b408b831. 2023-07-12 18:15:39,536 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=0106020e93799dbdff7abee4b408b831, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:15:39,537 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689185739113.0106020e93799dbdff7abee4b408b831.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689185739536"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689185739536"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689185739536"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689185739536"}]},"ts":"1689185739536"} 2023-07-12 18:15:39,540 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=67 2023-07-12 18:15:39,540 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure c8ffc4162cfabd16f3963b8add2d91f4, server=jenkins-hbase4.apache.org,34205,1689185653087 in 189 msec 2023-07-12 18:15:39,541 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=70, resume processing ppid=68 2023-07-12 18:15:39,541 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=70, ppid=68, state=SUCCESS; OpenRegionProcedure 0106020e93799dbdff7abee4b408b831, server=jenkins-hbase4.apache.org,34493,1689185653159 in 189 msec 2023-07-12 18:15:39,542 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=c8ffc4162cfabd16f3963b8add2d91f4, ASSIGN in 355 msec 2023-07-12 18:15:39,544 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=68, resume processing ppid=66 2023-07-12 18:15:39,544 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=0106020e93799dbdff7abee4b408b831, ASSIGN in 356 msec 2023-07-12 18:15:39,544 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 18:15:39,544 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689185739544"}]},"ts":"1689185739544"} 2023-07-12 18:15:39,546 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-07-12 18:15:39,548 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 18:15:39,549 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-07-12 18:15:39,551 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34493] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-12 18:15:39,553 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 18:15:39,553 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 18:15:39,553 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 18:15:39,553 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 18:15:39,555 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 18:15:39,555 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 18:15:39,555 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 18:15:39,555 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-12 18:15:39,555 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 18:15:39,555 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-12 18:15:39,555 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-12 18:15:39,555 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-12 18:15:39,556 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 440 msec 2023-07-12 18:15:39,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-12 18:15:39,728 INFO [Listener at jenkins-hbase4.apache.org/41393] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-07-12 18:15:39,758 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions c8ffc4162cfabd16f3963b8add2d91f4, 0106020e93799dbdff7abee4b408b831 2023-07-12 18:15:39,772 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[c8ffc4162cfabd16f3963b8add2d91f4, 0106020e93799dbdff7abee4b408b831], force=true 2023-07-12 18:15:39,774 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[c8ffc4162cfabd16f3963b8add2d91f4, 0106020e93799dbdff7abee4b408b831], force=true 2023-07-12 18:15:39,774 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[c8ffc4162cfabd16f3963b8add2d91f4, 0106020e93799dbdff7abee4b408b831], force=true 2023-07-12 18:15:39,774 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[c8ffc4162cfabd16f3963b8add2d91f4, 0106020e93799dbdff7abee4b408b831], force=true 2023-07-12 18:15:39,779 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-07-12 18:15:39,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-12 18:15:39,817 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=c8ffc4162cfabd16f3963b8add2d91f4, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=0106020e93799dbdff7abee4b408b831, UNASSIGN}] 2023-07-12 18:15:39,821 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=0106020e93799dbdff7abee4b408b831, UNASSIGN 2023-07-12 18:15:39,821 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=c8ffc4162cfabd16f3963b8add2d91f4, UNASSIGN 2023-07-12 18:15:39,822 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=0106020e93799dbdff7abee4b408b831, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:15:39,823 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689185739113.0106020e93799dbdff7abee4b408b831.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689185739822"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689185739822"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689185739822"}]},"ts":"1689185739822"} 2023-07-12 18:15:39,823 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=c8ffc4162cfabd16f3963b8add2d91f4, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:15:39,823 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689185739113.c8ffc4162cfabd16f3963b8add2d91f4.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689185739823"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689185739823"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689185739823"}]},"ts":"1689185739823"} 2023-07-12 18:15:39,825 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=74, ppid=73, state=RUNNABLE; CloseRegionProcedure 0106020e93799dbdff7abee4b408b831, server=jenkins-hbase4.apache.org,34493,1689185653159}] 2023-07-12 18:15:39,827 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=75, ppid=72, state=RUNNABLE; CloseRegionProcedure c8ffc4162cfabd16f3963b8add2d91f4, server=jenkins-hbase4.apache.org,34205,1689185653087}] 2023-07-12 18:15:39,887 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-12 18:15:39,980 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close c8ffc4162cfabd16f3963b8add2d91f4 2023-07-12 18:15:39,981 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 0106020e93799dbdff7abee4b408b831 2023-07-12 18:15:39,982 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c8ffc4162cfabd16f3963b8add2d91f4, disabling compactions & flushes 2023-07-12 18:15:39,983 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689185739113.c8ffc4162cfabd16f3963b8add2d91f4. 2023-07-12 18:15:39,984 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689185739113.c8ffc4162cfabd16f3963b8add2d91f4. 2023-07-12 18:15:39,984 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689185739113.c8ffc4162cfabd16f3963b8add2d91f4. after waiting 0 ms 2023-07-12 18:15:39,984 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 0106020e93799dbdff7abee4b408b831, disabling compactions & flushes 2023-07-12 18:15:39,984 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689185739113.0106020e93799dbdff7abee4b408b831. 2023-07-12 18:15:39,984 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689185739113.c8ffc4162cfabd16f3963b8add2d91f4. 2023-07-12 18:15:39,984 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689185739113.0106020e93799dbdff7abee4b408b831. 2023-07-12 18:15:39,985 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing c8ffc4162cfabd16f3963b8add2d91f4 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-12 18:15:39,985 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689185739113.0106020e93799dbdff7abee4b408b831. after waiting 0 ms 2023-07-12 18:15:39,985 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689185739113.0106020e93799dbdff7abee4b408b831. 2023-07-12 18:15:39,985 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 0106020e93799dbdff7abee4b408b831 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-12 18:15:40,061 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0106020e93799dbdff7abee4b408b831/.tmp/cf/0a6c9da02047403daa64291db40ee4a8 2023-07-12 18:15:40,068 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0106020e93799dbdff7abee4b408b831/.tmp/cf/0a6c9da02047403daa64291db40ee4a8 as hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0106020e93799dbdff7abee4b408b831/cf/0a6c9da02047403daa64291db40ee4a8 2023-07-12 18:15:40,082 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0106020e93799dbdff7abee4b408b831/cf/0a6c9da02047403daa64291db40ee4a8, entries=1, sequenceid=5, filesize=4.7 K 2023-07-12 18:15:40,084 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 0106020e93799dbdff7abee4b408b831 in 99ms, sequenceid=5, compaction requested=false 2023-07-12 18:15:40,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-12 18:15:40,098 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c8ffc4162cfabd16f3963b8add2d91f4/.tmp/cf/5a30b8dedb70469ca1337aabb40d786c 2023-07-12 18:15:40,113 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0106020e93799dbdff7abee4b408b831/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-12 18:15:40,124 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 18:15:40,124 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689185739113.0106020e93799dbdff7abee4b408b831. 2023-07-12 18:15:40,124 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 0106020e93799dbdff7abee4b408b831: 2023-07-12 18:15:40,129 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c8ffc4162cfabd16f3963b8add2d91f4/.tmp/cf/5a30b8dedb70469ca1337aabb40d786c as hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c8ffc4162cfabd16f3963b8add2d91f4/cf/5a30b8dedb70469ca1337aabb40d786c 2023-07-12 18:15:40,130 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 0106020e93799dbdff7abee4b408b831 2023-07-12 18:15:40,131 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=0106020e93799dbdff7abee4b408b831, regionState=CLOSED 2023-07-12 18:15:40,131 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689185739113.0106020e93799dbdff7abee4b408b831.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689185740131"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689185740131"}]},"ts":"1689185740131"} 2023-07-12 18:15:40,136 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=74, resume processing ppid=73 2023-07-12 18:15:40,136 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=74, ppid=73, state=SUCCESS; CloseRegionProcedure 0106020e93799dbdff7abee4b408b831, server=jenkins-hbase4.apache.org,34493,1689185653159 in 308 msec 2023-07-12 18:15:40,138 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=0106020e93799dbdff7abee4b408b831, UNASSIGN in 319 msec 2023-07-12 18:15:40,141 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c8ffc4162cfabd16f3963b8add2d91f4/cf/5a30b8dedb70469ca1337aabb40d786c, entries=1, sequenceid=5, filesize=4.7 K 2023-07-12 18:15:40,143 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for c8ffc4162cfabd16f3963b8add2d91f4 in 158ms, sequenceid=5, compaction requested=false 2023-07-12 18:15:40,175 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c8ffc4162cfabd16f3963b8add2d91f4/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-12 18:15:40,176 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 18:15:40,176 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689185739113.c8ffc4162cfabd16f3963b8add2d91f4. 2023-07-12 18:15:40,176 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c8ffc4162cfabd16f3963b8add2d91f4: 2023-07-12 18:15:40,179 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed c8ffc4162cfabd16f3963b8add2d91f4 2023-07-12 18:15:40,179 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=c8ffc4162cfabd16f3963b8add2d91f4, regionState=CLOSED 2023-07-12 18:15:40,179 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689185739113.c8ffc4162cfabd16f3963b8add2d91f4.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689185740179"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689185740179"}]},"ts":"1689185740179"} 2023-07-12 18:15:40,185 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=75, resume processing ppid=72 2023-07-12 18:15:40,185 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=75, ppid=72, state=SUCCESS; CloseRegionProcedure c8ffc4162cfabd16f3963b8add2d91f4, server=jenkins-hbase4.apache.org,34205,1689185653087 in 354 msec 2023-07-12 18:15:40,195 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=72, resume processing ppid=71 2023-07-12 18:15:40,196 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=c8ffc4162cfabd16f3963b8add2d91f4, UNASSIGN in 379 msec 2023-07-12 18:15:40,272 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fb56158c523f1cfe3d1bb92490659acd/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-07-12 18:15:40,275 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689185739113.c8ffc4162cfabd16f3963b8add2d91f4.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-12 18:15:40,275 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689185739113.0106020e93799dbdff7abee4b408b831.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-12 18:15:40,275 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689185739114.fb56158c523f1cfe3d1bb92490659acd.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-12 18:15:40,329 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=fb56158c523f1cfe3d1bb92490659acd, ASSIGN}] 2023-07-12 18:15:40,330 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=fb56158c523f1cfe3d1bb92490659acd, ASSIGN 2023-07-12 18:15:40,331 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=fb56158c523f1cfe3d1bb92490659acd, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,34205,1689185653087; forceNewPlan=false, retain=false 2023-07-12 18:15:40,390 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-12 18:15:40,481 INFO [jenkins-hbase4:43177] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-12 18:15:40,483 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=fb56158c523f1cfe3d1bb92490659acd, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:15:40,483 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689185739114.fb56158c523f1cfe3d1bb92490659acd.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689185740483"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689185740483"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689185740483"}]},"ts":"1689185740483"} 2023-07-12 18:15:40,485 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure fb56158c523f1cfe3d1bb92490659acd, server=jenkins-hbase4.apache.org,34205,1689185653087}] 2023-07-12 18:15:40,642 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689185739114.fb56158c523f1cfe3d1bb92490659acd. 2023-07-12 18:15:40,642 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => fb56158c523f1cfe3d1bb92490659acd, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689185739114.fb56158c523f1cfe3d1bb92490659acd.', STARTKEY => '', ENDKEY => ''} 2023-07-12 18:15:40,642 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689185739114.fb56158c523f1cfe3d1bb92490659acd. service=AccessControlService 2023-07-12 18:15:40,642 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 18:15:40,643 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 fb56158c523f1cfe3d1bb92490659acd 2023-07-12 18:15:40,643 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689185739114.fb56158c523f1cfe3d1bb92490659acd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 18:15:40,643 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for fb56158c523f1cfe3d1bb92490659acd 2023-07-12 18:15:40,643 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for fb56158c523f1cfe3d1bb92490659acd 2023-07-12 18:15:40,644 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fb56158c523f1cfe3d1bb92490659acd/.regioninfo 2023-07-12 18:15:40,707 INFO [StoreOpener-fb56158c523f1cfe3d1bb92490659acd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region fb56158c523f1cfe3d1bb92490659acd 2023-07-12 18:15:40,711 DEBUG [StoreOpener-fb56158c523f1cfe3d1bb92490659acd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fb56158c523f1cfe3d1bb92490659acd/cf 2023-07-12 18:15:40,711 DEBUG [StoreOpener-fb56158c523f1cfe3d1bb92490659acd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fb56158c523f1cfe3d1bb92490659acd/cf 2023-07-12 18:15:40,712 INFO [StoreOpener-fb56158c523f1cfe3d1bb92490659acd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fb56158c523f1cfe3d1bb92490659acd columnFamilyName cf 2023-07-12 18:15:40,763 DEBUG [StoreOpener-fb56158c523f1cfe3d1bb92490659acd-1] regionserver.HStore(539): loaded hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fb56158c523f1cfe3d1bb92490659acd/cf/0a6c9da02047403daa64291db40ee4a8.0106020e93799dbdff7abee4b408b831->hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0106020e93799dbdff7abee4b408b831/cf/0a6c9da02047403daa64291db40ee4a8-top 2023-07-12 18:15:40,770 DEBUG [StoreOpener-fb56158c523f1cfe3d1bb92490659acd-1] regionserver.HStore(539): loaded hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fb56158c523f1cfe3d1bb92490659acd/cf/5a30b8dedb70469ca1337aabb40d786c.c8ffc4162cfabd16f3963b8add2d91f4->hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c8ffc4162cfabd16f3963b8add2d91f4/cf/5a30b8dedb70469ca1337aabb40d786c-top 2023-07-12 18:15:40,771 INFO [StoreOpener-fb56158c523f1cfe3d1bb92490659acd-1] regionserver.HStore(310): Store=fb56158c523f1cfe3d1bb92490659acd/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 18:15:40,775 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fb56158c523f1cfe3d1bb92490659acd 2023-07-12 18:15:40,777 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fb56158c523f1cfe3d1bb92490659acd 2023-07-12 18:15:40,786 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for fb56158c523f1cfe3d1bb92490659acd 2023-07-12 18:15:40,787 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened fb56158c523f1cfe3d1bb92490659acd; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63072063, jitterRate=-0.06015302240848541}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 18:15:40,788 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for fb56158c523f1cfe3d1bb92490659acd: 2023-07-12 18:15:40,794 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689185739114.fb56158c523f1cfe3d1bb92490659acd., pid=77, masterSystemTime=1689185740637 2023-07-12 18:15:40,795 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1689185739114.fb56158c523f1cfe3d1bb92490659acd.,because compaction is disabled. 2023-07-12 18:15:40,797 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689185739114.fb56158c523f1cfe3d1bb92490659acd. 2023-07-12 18:15:40,797 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689185739114.fb56158c523f1cfe3d1bb92490659acd. 2023-07-12 18:15:40,797 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=fb56158c523f1cfe3d1bb92490659acd, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:15:40,798 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689185739114.fb56158c523f1cfe3d1bb92490659acd.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689185740797"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689185740797"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689185740797"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689185740797"}]},"ts":"1689185740797"} 2023-07-12 18:15:40,805 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-07-12 18:15:40,806 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure fb56158c523f1cfe3d1bb92490659acd, server=jenkins-hbase4.apache.org,34205,1689185653087 in 317 msec 2023-07-12 18:15:40,814 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=71 2023-07-12 18:15:40,814 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=fb56158c523f1cfe3d1bb92490659acd, ASSIGN in 476 msec 2023-07-12 18:15:40,818 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[c8ffc4162cfabd16f3963b8add2d91f4, 0106020e93799dbdff7abee4b408b831], force=true in 1.0510 sec 2023-07-12 18:15:40,891 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-12 18:15:40,891 INFO [Listener at jenkins-hbase4.apache.org/41393] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-07-12 18:15:40,892 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-12 18:15:40,892 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689185740892 (current time:1689185740892). 2023-07-12 18:15:40,892 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 18:15:40,893 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] zookeeper.ReadOnlyZKClient(139): Connect 0x0bc3dbdd to 127.0.0.1:62122 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 18:15:40,912 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3f604841, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 18:15:40,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 18:15:40,915 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37166, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 18:15:40,916 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0bc3dbdd to 127.0.0.1:62122 2023-07-12 18:15:40,917 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 18:15:40,917 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] zookeeper.ReadOnlyZKClient(139): Connect 0x2f299c64 to 127.0.0.1:62122 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 18:15:40,928 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3aa1b76f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 18:15:40,947 DEBUG [hconnection-0x73ec23a-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 18:15:40,952 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37180, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 18:15:40,962 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2f299c64 to 127.0.0.1:62122 2023-07-12 18:15:40,962 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 18:15:40,962 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-12 18:15:40,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 18:15:40,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-12 18:15:40,966 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-12 18:15:40,968 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-12 18:15:40,969 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1689186340969 2023-07-12 18:15:40,970 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-12 18:15:40,970 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:40,976 DEBUG [Listener at jenkins-hbase4.apache.org/41393] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 18:15:40,978 DEBUG [Listener at jenkins-hbase4.apache.org/41393] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 18:15:40,979 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-12 18:15:40,978 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-12 18:15:40,986 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 17 msec 2023-07-12 18:15:40,987 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-12 18:15:40,989 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1689186340989 2023-07-12 18:15:41,078 DEBUG [Listener at jenkins-hbase4.apache.org/41393] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 18:15:41,079 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-12 18:15:41,080 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-12 18:15:41,080 DEBUG [Listener at jenkins-hbase4.apache.org/41393] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 18:15:41,222 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689185662417_0004_000001 (auth:SIMPLE) 2023-07-12 18:15:41,280 DEBUG [Listener at jenkins-hbase4.apache.org/41393] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 18:15:41,281 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-12 18:15:41,282 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-12 18:15:41,282 DEBUG [Listener at jenkins-hbase4.apache.org/41393] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-12 18:15:41,434 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:41,435 INFO [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-07-12 18:15:41,435 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 18:15:41,435 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-07-12 18:15:41,435 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-07-12 18:15:41,435 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:41,435 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:41,438 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:15:41,438 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:15:41,438 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:15:41,438 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:15:41,438 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:15:41,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:15:41,438 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:15:41,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:15:41,438 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:15:41,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:15:41,438 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:15:41,439 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 18:15:41,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:41,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:41,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:41,439 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:41,439 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:41,439 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:41,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-12 18:15:41,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:41,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-12 18:15:41,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:41,440 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-12 18:15:41,440 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-12 18:15:41,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-12 18:15:41,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:41,440 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:41,440 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-12 18:15:41,440 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-12 18:15:41,440 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 18:15:41,440 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:41,440 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:41,442 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-12 18:15:41,442 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-12 18:15:41,442 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 18:15:41,440 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-12 18:15:41,442 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 18:15:41,442 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-12 18:15:41,444 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-12 18:15:41,444 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-12 18:15:41,444 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34493,1689185653159' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-12 18:15:41,444 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34205,1689185653087' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-12 18:15:41,444 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-12 18:15:41,444 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-12 18:15:41,444 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37689,1689185653014' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-12 18:15:41,446 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:41,446 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:15:41,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:15:41,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 18:15:41,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 18:15:41,450 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:41,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 18:15:41,451 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:41,450 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:41,451 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 18:15:41,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 18:15:41,451 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:41,451 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 18:15:41,451 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:41,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:41,451 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 18:15:41,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:15:41,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:15:41,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:15:41,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 18:15:41,453 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34205,1689185653087' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-07-12 18:15:41,453 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6486f9c4[Count = 0] remaining members to acquire global barrier 2023-07-12 18:15:41,453 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-07-12 18:15:41,453 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:41,454 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:41,454 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:41,454 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:41,454 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:41,454 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:41,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:41,454 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:41,454 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:15:41,454 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 18:15:41,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:41,454 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-12 18:15:41,454 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-12 18:15:41,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:41,454 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-12 18:15:41,455 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,34493,1689185653159' in zk 2023-07-12 18:15:41,455 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-12 18:15:41,455 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 18:15:41,455 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 18:15:41,455 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-12 18:15:41,455 DEBUG [rs(jenkins-hbase4.apache.org,34205,1689185653087)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689185739114.fb56158c523f1cfe3d1bb92490659acd. 2023-07-12 18:15:41,455 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,37689,1689185653014' in zk 2023-07-12 18:15:41,455 DEBUG [rs(jenkins-hbase4.apache.org,34205,1689185653087)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689185739114.fb56158c523f1cfe3d1bb92490659acd. started... 2023-07-12 18:15:41,456 DEBUG [rs(jenkins-hbase4.apache.org,34205,1689185653087)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for fb56158c523f1cfe3d1bb92490659acd: 2023-07-12 18:15:41,457 DEBUG [rs(jenkins-hbase4.apache.org,34205,1689185653087)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689185739114.fb56158c523f1cfe3d1bb92490659acd.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:41,457 DEBUG [rs(jenkins-hbase4.apache.org,34205,1689185653087)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 18:15:41,457 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-12 18:15:41,457 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 18:15:41,457 DEBUG [rs(jenkins-hbase4.apache.org,34205,1689185653087)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fb56158c523f1cfe3d1bb92490659acd/cf/0a6c9da02047403daa64291db40ee4a8.0106020e93799dbdff7abee4b408b831->hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0106020e93799dbdff7abee4b408b831/cf/0a6c9da02047403daa64291db40ee4a8-top, hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fb56158c523f1cfe3d1bb92490659acd/cf/5a30b8dedb70469ca1337aabb40d786c.c8ffc4162cfabd16f3963b8add2d91f4->hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c8ffc4162cfabd16f3963b8add2d91f4/cf/5a30b8dedb70469ca1337aabb40d786c-top] hfiles 2023-07-12 18:15:41,457 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-12 18:15:41,459 DEBUG [rs(jenkins-hbase4.apache.org,34205,1689185653087)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fb56158c523f1cfe3d1bb92490659acd/cf/0a6c9da02047403daa64291db40ee4a8.0106020e93799dbdff7abee4b408b831 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:41,459 DEBUG [rs(jenkins-hbase4.apache.org,34205,1689185653087)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fb56158c523f1cfe3d1bb92490659acd/cf/5a30b8dedb70469ca1337aabb40d786c.c8ffc4162cfabd16f3963b8add2d91f4 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:41,460 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-12 18:15:41,460 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 18:15:41,460 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-12 18:15:41,489 DEBUG [rs(jenkins-hbase4.apache.org,34205,1689185653087)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689185739114.fb56158c523f1cfe3d1bb92490659acd. completed. 2023-07-12 18:15:41,490 DEBUG [rs(jenkins-hbase4.apache.org,34205,1689185653087)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689185739114.fb56158c523f1cfe3d1bb92490659acd. 2023-07-12 18:15:41,490 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 18:15:41,490 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 18:15:41,490 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:15:41,490 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-12 18:15:41,490 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,34205,1689185653087' in zk 2023-07-12 18:15:41,496 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-12 18:15:41,496 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:15:41,496 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 18:15:41,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:15:41,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 18:15:41,496 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-12 18:15:41,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 18:15:41,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 18:15:41,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 18:15:41,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:41,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:15:41,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:15:41,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:15:41,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 18:15:41,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:41,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:15:41,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:15:41,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:15:41,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,34205,1689185653087': 2023-07-12 18:15:41,502 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34205,1689185653087' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-07-12 18:15:41,502 INFO [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-07-12 18:15:41,502 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 18:15:41,502 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 18:15:41,502 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:41,502 INFO [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 18:15:41,505 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:41,505 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:15:41,505 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:41,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:41,505 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:41,505 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:15:41,505 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:41,505 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:41,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:41,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:41,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 18:15:41,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 18:15:41,506 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:15:41,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:15:41,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 18:15:41,506 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:15:41,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:15:41,506 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:15:41,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:41,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:41,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:41,506 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:15:41,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 18:15:41,507 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:15:41,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:41,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:15:41,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:15:41,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:15:41,509 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:15:41,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 18:15:41,509 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:15:41,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:41,509 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:15:41,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:15:41,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:15:41,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:15:41,510 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:41,510 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:15:41,510 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:41,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:41,511 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:15:41,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:15:41,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:41,516 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:15:41,516 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:15:41,516 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:15:41,516 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:15:41,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:15:41,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:15:41,516 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:15:41,516 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:15:41,516 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:15:41,516 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:15:41,516 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:15:41,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:15:41,518 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:15:41,518 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:15:41,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:15:41,518 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:15:41,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:15:41,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:15:41,518 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:15:41,519 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:41,519 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:15:41,519 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:15:41,519 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:41,519 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:15:41,519 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:41,519 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:41,519 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:41,519 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 18:15:41,519 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:15:41,519 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:15:41,519 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:41,519 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:41,520 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:41,547 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:41,582 DEBUG [Listener at jenkins-hbase4.apache.org/41393] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 18:15:41,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-12 18:15:41,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-12 18:15:41,584 DEBUG [Listener at jenkins-hbase4.apache.org/41393] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-12 18:15:41,603 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-07-12 18:15:41,603 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:41,604 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:41,604 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1689185740970Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689185741519 (+549 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689185741519Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689185741529 (+10 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689185741540 (+11 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1689185741603 (+63 ms) 2023-07-12 18:15:41,612 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-12 18:15:41,614 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 636 msec 2023-07-12 18:15:42,084 DEBUG [Listener at jenkins-hbase4.apache.org/41393] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 18:15:42,085 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-12 18:15:42,085 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 18:15:42,085 INFO [Listener at jenkins-hbase4.apache.org/41393] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/export-test/export-1689185742085 2023-07-12 18:15:42,086 INFO [Listener at jenkins-hbase4.apache.org/41393] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:38679, tgtDir=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/export-test/export-1689185742085, rawTgtDir=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/export-test/export-1689185742085, srcFsUri=hdfs://localhost:38679, srcDir=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0 2023-07-12 18:15:42,108 DEBUG [Listener at jenkins-hbase4.apache.org/41393] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:38679, inputRoot=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0 2023-07-12 18:15:42,108 DEBUG [Listener at jenkins-hbase4.apache.org/41393] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1493314606_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/export-test/export-1689185742085, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/export-test/export-1689185742085/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:42,108 INFO [Listener at jenkins-hbase4.apache.org/41393] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:38679, inputRoot=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0, snapshotDir=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-07-12 18:15:42,117 INFO [Listener at jenkins-hbase4.apache.org/41393] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/export-test/export-1689185742085/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:42,134 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-12 18:15:42,135 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-12 18:15:42,135 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-12 18:15:42,135 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-12 18:15:42,173 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-12 18:15:43,246 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/908563f7-ecc5-f8cf-2e08-f8e1a8353ad0/hadoop-3377773001671408875.jar 2023-07-12 18:15:43,247 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-12 18:15:43,247 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-12 18:15:43,342 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/908563f7-ecc5-f8cf-2e08-f8e1a8353ad0/hadoop-4966152158608052272.jar 2023-07-12 18:15:43,343 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-12 18:15:43,343 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-12 18:15:43,344 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-12 18:15:43,345 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-12 18:15:43,345 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-12 18:15:43,346 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-12 18:15:43,346 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-12 18:15:43,347 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-12 18:15:43,348 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-12 18:15:43,348 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-12 18:15:43,349 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-12 18:15:43,350 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-12 18:15:43,350 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-12 18:15:43,351 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-12 18:15:43,351 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-12 18:15:43,352 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-12 18:15:43,353 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 18:15:43,353 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 18:15:43,354 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 18:15:43,355 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 18:15:43,355 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 18:15:43,356 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 18:15:43,357 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 18:15:44,535 WARN [Listener at jenkins-hbase4.apache.org/41393] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-12 18:15:44,538 INFO [Listener at jenkins-hbase4.apache.org/41393] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-07-12 18:15:44,541 DEBUG [Listener at jenkins-hbase4.apache.org/41393] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-07-12 18:15:44,692 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 18:15:44,692 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 18:15:45,220 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689185662417_0005_000001 (auth:SIMPLE) 2023-07-12 18:15:51,794 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689185662417_0005_000001 (auth:SIMPLE) 2023-07-12 18:15:54,104 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689185662417_0005_000001 (auth:SIMPLE) 2023-07-12 18:16:00,861 INFO [Listener at jenkins-hbase4.apache.org/41393] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-12 18:16:00,865 INFO [Listener at jenkins-hbase4.apache.org/41393] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-12 18:16:00,876 INFO [Listener at jenkins-hbase4.apache.org/41393] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:16:00,876 INFO [Listener at jenkins-hbase4.apache.org/41393] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-12 18:16:00,877 INFO [Listener at jenkins-hbase4.apache.org/41393] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-12 18:16:00,877 DEBUG [Listener at jenkins-hbase4.apache.org/41393] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-639947816_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:16:00,878 DEBUG [Listener at jenkins-hbase4.apache.org/41393] snapshot.TestExportSnapshot(367): hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-12 18:16:00,878 DEBUG [Listener at jenkins-hbase4.apache.org/41393] snapshot.TestExportSnapshot(367): hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-12 18:16:00,878 DEBUG [Listener at jenkins-hbase4.apache.org/41393] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-639947816_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/export-test/export-1689185742085/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/export-test/export-1689185742085/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:16:00,879 DEBUG [Listener at jenkins-hbase4.apache.org/41393] snapshot.TestExportSnapshot(367): hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/export-test/export-1689185742085/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-12 18:16:00,879 DEBUG [Listener at jenkins-hbase4.apache.org/41393] snapshot.TestExportSnapshot(367): hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/export-test/export-1689185742085/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-12 18:16:00,887 INFO [Listener at jenkins-hbase4.apache.org/41393] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:16:00,888 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:16:00,889 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] procedure2.ProcedureExecutor(1029): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:16:00,893 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689185760893"}]},"ts":"1689185760893"} 2023-07-12 18:16:00,895 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-07-12 18:16:00,896 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-12 18:16:00,898 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-07-12 18:16:00,899 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=fb56158c523f1cfe3d1bb92490659acd, UNASSIGN}] 2023-07-12 18:16:00,902 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=fb56158c523f1cfe3d1bb92490659acd, UNASSIGN 2023-07-12 18:16:00,903 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=fb56158c523f1cfe3d1bb92490659acd, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:16:00,903 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689185739114.fb56158c523f1cfe3d1bb92490659acd.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689185760903"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689185760903"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689185760903"}]},"ts":"1689185760903"} 2023-07-12 18:16:00,905 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure fb56158c523f1cfe3d1bb92490659acd, server=jenkins-hbase4.apache.org,34205,1689185653087}] 2023-07-12 18:16:00,997 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-12 18:16:01,059 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close fb56158c523f1cfe3d1bb92490659acd 2023-07-12 18:16:01,060 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing fb56158c523f1cfe3d1bb92490659acd, disabling compactions & flushes 2023-07-12 18:16:01,060 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689185739114.fb56158c523f1cfe3d1bb92490659acd. 2023-07-12 18:16:01,060 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689185739114.fb56158c523f1cfe3d1bb92490659acd. 2023-07-12 18:16:01,060 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689185739114.fb56158c523f1cfe3d1bb92490659acd. after waiting 0 ms 2023-07-12 18:16:01,060 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689185739114.fb56158c523f1cfe3d1bb92490659acd. 2023-07-12 18:16:01,103 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fb56158c523f1cfe3d1bb92490659acd/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-07-12 18:16:01,104 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 18:16:01,106 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689185739114.fb56158c523f1cfe3d1bb92490659acd. 2023-07-12 18:16:01,106 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for fb56158c523f1cfe3d1bb92490659acd: 2023-07-12 18:16:01,111 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed fb56158c523f1cfe3d1bb92490659acd 2023-07-12 18:16:01,111 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=fb56158c523f1cfe3d1bb92490659acd, regionState=CLOSED 2023-07-12 18:16:01,111 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689185739114.fb56158c523f1cfe3d1bb92490659acd.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689185761111"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689185761111"}]},"ts":"1689185761111"} 2023-07-12 18:16:01,119 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=82, resume processing ppid=81 2023-07-12 18:16:01,119 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure fb56158c523f1cfe3d1bb92490659acd, server=jenkins-hbase4.apache.org,34205,1689185653087 in 209 msec 2023-07-12 18:16:01,123 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=80 2023-07-12 18:16:01,123 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=fb56158c523f1cfe3d1bb92490659acd, UNASSIGN in 221 msec 2023-07-12 18:16:01,124 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689185761124"}]},"ts":"1689185761124"} 2023-07-12 18:16:01,128 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-07-12 18:16:01,134 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-07-12 18:16:01,140 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 249 msec 2023-07-12 18:16:01,199 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-12 18:16:01,199 INFO [Listener at jenkins-hbase4.apache.org/41393] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-07-12 18:16:01,200 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:16:01,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] procedure2.ProcedureExecutor(1029): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:16:01,204 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:16:01,204 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:16:01,206 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:16:01,207 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34493] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:16:01,211 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:16:01,211 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:16:01,211 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:16:01,211 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:16:01,211 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-12 18:16:01,212 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-12 18:16:01,212 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-12 18:16:01,215 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fb56158c523f1cfe3d1bb92490659acd 2023-07-12 18:16:01,215 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-12 18:16:01,216 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:16:01,216 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:16:01,216 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 18:16:01,216 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 18:16:01,216 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:16:01,217 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 18:16:01,216 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:16:01,217 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 18:16:01,217 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 18:16:01,217 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fb56158c523f1cfe3d1bb92490659acd/cf, FileablePath, hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fb56158c523f1cfe3d1bb92490659acd/recovered.edits] 2023-07-12 18:16:01,218 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 18:16:01,218 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-12 18:16:01,218 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 18:16:01,218 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 18:16:01,221 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0106020e93799dbdff7abee4b408b831 2023-07-12 18:16:01,222 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c8ffc4162cfabd16f3963b8add2d91f4 2023-07-12 18:16:01,227 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0106020e93799dbdff7abee4b408b831/cf, FileablePath, hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0106020e93799dbdff7abee4b408b831/recovered.edits] 2023-07-12 18:16:01,230 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c8ffc4162cfabd16f3963b8add2d91f4/cf, FileablePath, hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c8ffc4162cfabd16f3963b8add2d91f4/recovered.edits] 2023-07-12 18:16:01,236 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fb56158c523f1cfe3d1bb92490659acd/cf/0a6c9da02047403daa64291db40ee4a8.0106020e93799dbdff7abee4b408b831 to hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fb56158c523f1cfe3d1bb92490659acd/cf/0a6c9da02047403daa64291db40ee4a8.0106020e93799dbdff7abee4b408b831 2023-07-12 18:16:01,237 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0106020e93799dbdff7abee4b408b831/cf/0a6c9da02047403daa64291db40ee4a8 to hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0106020e93799dbdff7abee4b408b831/cf/0a6c9da02047403daa64291db40ee4a8 2023-07-12 18:16:01,241 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fb56158c523f1cfe3d1bb92490659acd/cf/5a30b8dedb70469ca1337aabb40d786c.c8ffc4162cfabd16f3963b8add2d91f4 to hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fb56158c523f1cfe3d1bb92490659acd/cf/5a30b8dedb70469ca1337aabb40d786c.c8ffc4162cfabd16f3963b8add2d91f4 2023-07-12 18:16:01,247 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c8ffc4162cfabd16f3963b8add2d91f4/cf/5a30b8dedb70469ca1337aabb40d786c to hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c8ffc4162cfabd16f3963b8add2d91f4/cf/5a30b8dedb70469ca1337aabb40d786c 2023-07-12 18:16:01,247 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0106020e93799dbdff7abee4b408b831/recovered.edits/8.seqid to hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0106020e93799dbdff7abee4b408b831/recovered.edits/8.seqid 2023-07-12 18:16:01,248 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0106020e93799dbdff7abee4b408b831 2023-07-12 18:16:01,249 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fb56158c523f1cfe3d1bb92490659acd/recovered.edits/12.seqid to hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fb56158c523f1cfe3d1bb92490659acd/recovered.edits/12.seqid 2023-07-12 18:16:01,250 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fb56158c523f1cfe3d1bb92490659acd 2023-07-12 18:16:01,252 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c8ffc4162cfabd16f3963b8add2d91f4/recovered.edits/8.seqid to hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c8ffc4162cfabd16f3963b8add2d91f4/recovered.edits/8.seqid 2023-07-12 18:16:01,253 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c8ffc4162cfabd16f3963b8add2d91f4 2023-07-12 18:16:01,253 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-12 18:16:01,260 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:16:01,266 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-07-12 18:16:01,277 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-07-12 18:16:01,278 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:16:01,278 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-07-12 18:16:01,278 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689185739114.fb56158c523f1cfe3d1bb92490659acd.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689185761278"}]},"ts":"9223372036854775807"} 2023-07-12 18:16:01,280 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-07-12 18:16:01,280 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => fb56158c523f1cfe3d1bb92490659acd, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689185739114.fb56158c523f1cfe3d1bb92490659acd.', STARTKEY => '', ENDKEY => ''}] 2023-07-12 18:16:01,280 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-07-12 18:16:01,280 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689185761280"}]},"ts":"9223372036854775807"} 2023-07-12 18:16:01,282 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-07-12 18:16:01,286 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:16:01,288 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 86 msec 2023-07-12 18:16:01,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-12 18:16:01,320 INFO [Listener at jenkins-hbase4.apache.org/41393] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-07-12 18:16:01,321 INFO [Listener at jenkins-hbase4.apache.org/41393] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 18:16:01,321 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 18:16:01,323 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] procedure2.ProcedureExecutor(1029): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 18:16:01,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-12 18:16:01,328 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689185761328"}]},"ts":"1689185761328"} 2023-07-12 18:16:01,330 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-07-12 18:16:01,331 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-07-12 18:16:01,332 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=4f7f7d9d9128a95660641bdd0b71a19c, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=5ac33830d086b3a7de54a793dff578ae, UNASSIGN}] 2023-07-12 18:16:01,337 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=4f7f7d9d9128a95660641bdd0b71a19c, UNASSIGN 2023-07-12 18:16:01,338 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=5ac33830d086b3a7de54a793dff578ae, UNASSIGN 2023-07-12 18:16:01,339 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=4f7f7d9d9128a95660641bdd0b71a19c, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:16:01,339 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=5ac33830d086b3a7de54a793dff578ae, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:16:01,339 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689185736889.4f7f7d9d9128a95660641bdd0b71a19c.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689185761339"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689185761339"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689185761339"}]},"ts":"1689185761339"} 2023-07-12 18:16:01,339 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689185736889.5ac33830d086b3a7de54a793dff578ae.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689185761339"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689185761339"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689185761339"}]},"ts":"1689185761339"} 2023-07-12 18:16:01,342 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=87, ppid=85, state=RUNNABLE; CloseRegionProcedure 4f7f7d9d9128a95660641bdd0b71a19c, server=jenkins-hbase4.apache.org,34205,1689185653087}] 2023-07-12 18:16:01,342 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=88, ppid=86, state=RUNNABLE; CloseRegionProcedure 5ac33830d086b3a7de54a793dff578ae, server=jenkins-hbase4.apache.org,34493,1689185653159}] 2023-07-12 18:16:01,429 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-12 18:16:01,497 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 4f7f7d9d9128a95660641bdd0b71a19c 2023-07-12 18:16:01,498 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 4f7f7d9d9128a95660641bdd0b71a19c, disabling compactions & flushes 2023-07-12 18:16:01,498 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689185736889.4f7f7d9d9128a95660641bdd0b71a19c. 2023-07-12 18:16:01,498 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689185736889.4f7f7d9d9128a95660641bdd0b71a19c. 2023-07-12 18:16:01,498 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689185736889.4f7f7d9d9128a95660641bdd0b71a19c. after waiting 0 ms 2023-07-12 18:16:01,498 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689185736889.4f7f7d9d9128a95660641bdd0b71a19c. 2023-07-12 18:16:01,498 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 5ac33830d086b3a7de54a793dff578ae 2023-07-12 18:16:01,498 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 5ac33830d086b3a7de54a793dff578ae, disabling compactions & flushes 2023-07-12 18:16:01,498 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689185736889.5ac33830d086b3a7de54a793dff578ae. 2023-07-12 18:16:01,498 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689185736889.5ac33830d086b3a7de54a793dff578ae. 2023-07-12 18:16:01,498 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689185736889.5ac33830d086b3a7de54a793dff578ae. after waiting 0 ms 2023-07-12 18:16:01,498 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689185736889.5ac33830d086b3a7de54a793dff578ae. 2023-07-12 18:16:01,518 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testExportFileSystemStateWithMergeRegion/5ac33830d086b3a7de54a793dff578ae/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 18:16:01,518 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testExportFileSystemStateWithMergeRegion/4f7f7d9d9128a95660641bdd0b71a19c/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 18:16:01,518 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 18:16:01,518 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 18:16:01,519 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689185736889.5ac33830d086b3a7de54a793dff578ae. 2023-07-12 18:16:01,521 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689185736889.4f7f7d9d9128a95660641bdd0b71a19c. 2023-07-12 18:16:01,521 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 5ac33830d086b3a7de54a793dff578ae: 2023-07-12 18:16:01,521 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 4f7f7d9d9128a95660641bdd0b71a19c: 2023-07-12 18:16:01,523 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 5ac33830d086b3a7de54a793dff578ae 2023-07-12 18:16:01,523 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=5ac33830d086b3a7de54a793dff578ae, regionState=CLOSED 2023-07-12 18:16:01,523 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689185736889.5ac33830d086b3a7de54a793dff578ae.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689185761523"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689185761523"}]},"ts":"1689185761523"} 2023-07-12 18:16:01,523 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 4f7f7d9d9128a95660641bdd0b71a19c 2023-07-12 18:16:01,524 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=4f7f7d9d9128a95660641bdd0b71a19c, regionState=CLOSED 2023-07-12 18:16:01,524 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689185736889.4f7f7d9d9128a95660641bdd0b71a19c.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689185761524"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689185761524"}]},"ts":"1689185761524"} 2023-07-12 18:16:01,528 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=88, resume processing ppid=86 2023-07-12 18:16:01,528 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=88, ppid=86, state=SUCCESS; CloseRegionProcedure 5ac33830d086b3a7de54a793dff578ae, server=jenkins-hbase4.apache.org,34493,1689185653159 in 183 msec 2023-07-12 18:16:01,529 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=87, resume processing ppid=85 2023-07-12 18:16:01,529 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=87, ppid=85, state=SUCCESS; CloseRegionProcedure 4f7f7d9d9128a95660641bdd0b71a19c, server=jenkins-hbase4.apache.org,34205,1689185653087 in 185 msec 2023-07-12 18:16:01,529 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=5ac33830d086b3a7de54a793dff578ae, UNASSIGN in 196 msec 2023-07-12 18:16:01,534 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=85, resume processing ppid=84 2023-07-12 18:16:01,534 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=4f7f7d9d9128a95660641bdd0b71a19c, UNASSIGN in 197 msec 2023-07-12 18:16:01,534 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689185761534"}]},"ts":"1689185761534"} 2023-07-12 18:16:01,536 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-07-12 18:16:01,538 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-07-12 18:16:01,545 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 218 msec 2023-07-12 18:16:01,630 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-12 18:16:01,630 INFO [Listener at jenkins-hbase4.apache.org/41393] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-07-12 18:16:01,631 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 18:16:01,632 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] procedure2.ProcedureExecutor(1029): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 18:16:01,638 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 18:16:01,638 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 18:16:01,639 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 18:16:01,640 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34493] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 18:16:01,644 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/4f7f7d9d9128a95660641bdd0b71a19c 2023-07-12 18:16:01,644 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/5ac33830d086b3a7de54a793dff578ae 2023-07-12 18:16:01,644 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 18:16:01,644 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 18:16:01,644 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 18:16:01,644 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 18:16:01,645 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-12 18:16:01,645 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-12 18:16:01,645 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-12 18:16:01,645 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-12 18:16:01,647 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 18:16:01,647 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 18:16:01,647 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 18:16:01,647 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 18:16:01,647 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 18:16:01,647 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 18:16:01,647 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 18:16:01,647 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/4f7f7d9d9128a95660641bdd0b71a19c/cf, FileablePath, hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/4f7f7d9d9128a95660641bdd0b71a19c/recovered.edits] 2023-07-12 18:16:01,647 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 18:16:01,648 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/5ac33830d086b3a7de54a793dff578ae/cf, FileablePath, hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/5ac33830d086b3a7de54a793dff578ae/recovered.edits] 2023-07-12 18:16:01,648 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-12 18:16:01,653 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/4f7f7d9d9128a95660641bdd0b71a19c/cf/42e49ecb44c84755a7d947280eeb65df to hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/4f7f7d9d9128a95660641bdd0b71a19c/cf/42e49ecb44c84755a7d947280eeb65df 2023-07-12 18:16:01,653 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/5ac33830d086b3a7de54a793dff578ae/cf/856bed47d5d04eafa291081fc4d4e4c6 to hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/5ac33830d086b3a7de54a793dff578ae/cf/856bed47d5d04eafa291081fc4d4e4c6 2023-07-12 18:16:01,656 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/4f7f7d9d9128a95660641bdd0b71a19c/recovered.edits/9.seqid to hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/4f7f7d9d9128a95660641bdd0b71a19c/recovered.edits/9.seqid 2023-07-12 18:16:01,657 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/5ac33830d086b3a7de54a793dff578ae/recovered.edits/9.seqid to hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/5ac33830d086b3a7de54a793dff578ae/recovered.edits/9.seqid 2023-07-12 18:16:01,657 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/4f7f7d9d9128a95660641bdd0b71a19c 2023-07-12 18:16:01,657 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/5ac33830d086b3a7de54a793dff578ae 2023-07-12 18:16:01,658 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-12 18:16:01,658 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-07-12 18:16:01,659 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf] 2023-07-12 18:16:01,664 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230712ec1205ce14494afb8ebef5fc02322d0c to hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230712ec1205ce14494afb8ebef5fc02322d0c 2023-07-12 18:16:01,665 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202307121a30bccba60b4f08a35b79a7a5012e44 to hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202307121a30bccba60b4f08a35b79a7a5012e44 2023-07-12 18:16:01,666 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-07-12 18:16:01,668 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 18:16:01,671 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-07-12 18:16:01,674 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-07-12 18:16:01,675 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 18:16:01,675 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-07-12 18:16:01,676 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689185736889.4f7f7d9d9128a95660641bdd0b71a19c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689185761675"}]},"ts":"9223372036854775807"} 2023-07-12 18:16:01,676 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689185736889.5ac33830d086b3a7de54a793dff578ae.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689185761675"}]},"ts":"9223372036854775807"} 2023-07-12 18:16:01,678 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-12 18:16:01,678 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 4f7f7d9d9128a95660641bdd0b71a19c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689185736889.4f7f7d9d9128a95660641bdd0b71a19c.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 5ac33830d086b3a7de54a793dff578ae, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689185736889.5ac33830d086b3a7de54a793dff578ae.', STARTKEY => '1', ENDKEY => ''}] 2023-07-12 18:16:01,678 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-07-12 18:16:01,678 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689185761678"}]},"ts":"9223372036854775807"} 2023-07-12 18:16:01,686 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-07-12 18:16:01,688 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 18:16:01,689 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 57 msec 2023-07-12 18:16:01,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-12 18:16:01,750 INFO [Listener at jenkins-hbase4.apache.org/41393] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-07-12 18:16:01,768 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-12 18:16:01,770 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:16:01,772 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-12 18:16:01,774 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:16:01,776 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-07-12 18:16:01,785 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:16:01,824 INFO [Listener at jenkins-hbase4.apache.org/41393] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=759 (was 746) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-639947816_17 at /127.0.0.1:34528 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x30e4ce87-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4109 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-639947816_17 at /127.0.0.1:34514 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-701319211_1 at /127.0.0.1:45016 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-639947816_17 at /127.0.0.1:43528 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x30e4ce87-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x30e4ce87-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1506713691) connection to jenkins-hbase4.apache.org/172.31.14.131:42111 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x30e4ce87-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1506713691) connection to jenkins-hbase4.apache.org/172.31.14.131:41393 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x30e4ce87-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-639947816_17 at /127.0.0.1:38766 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x30e4ce87-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=904 (was 892) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=597 (was 498) - SystemLoadAverage LEAK? -, ProcessCount=179 (was 179), AvailableMemoryMB=3704 (was 4377) 2023-07-12 18:16:01,824 WARN [Listener at jenkins-hbase4.apache.org/41393] hbase.ResourceChecker(130): Thread=759 is superior to 500 2023-07-12 18:16:01,876 INFO [Listener at jenkins-hbase4.apache.org/41393] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=759, OpenFileDescriptor=906, MaxFileDescriptor=60000, SystemLoadAverage=597, ProcessCount=179, AvailableMemoryMB=3701 2023-07-12 18:16:01,876 WARN [Listener at jenkins-hbase4.apache.org/41393] hbase.ResourceChecker(130): Thread=759 is superior to 500 2023-07-12 18:16:01,878 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-12 18:16:01,879 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] procedure2.ProcedureExecutor(1029): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-12 18:16:01,883 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 18:16:01,883 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-07-12 18:16:01,884 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 18:16:01,887 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-12 18:16:01,892 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testEmptyExportFileSystemState/6ad0635dded66a2aae707f83fc2af45c 2023-07-12 18:16:01,892 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testEmptyExportFileSystemState/cf9b283b4e4ab08db89bfd30836ffc39 2023-07-12 18:16:01,893 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testEmptyExportFileSystemState/6ad0635dded66a2aae707f83fc2af45c empty. 2023-07-12 18:16:01,893 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testEmptyExportFileSystemState/6ad0635dded66a2aae707f83fc2af45c 2023-07-12 18:16:01,893 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testEmptyExportFileSystemState/cf9b283b4e4ab08db89bfd30836ffc39 empty. 2023-07-12 18:16:01,894 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testEmptyExportFileSystemState/cf9b283b4e4ab08db89bfd30836ffc39 2023-07-12 18:16:01,894 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-12 18:16:01,946 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-12 18:16:01,948 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 6ad0635dded66a2aae707f83fc2af45c, NAME => 'testtb-testEmptyExportFileSystemState,,1689185761878.6ad0635dded66a2aae707f83fc2af45c.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp 2023-07-12 18:16:01,948 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => cf9b283b4e4ab08db89bfd30836ffc39, NAME => 'testtb-testEmptyExportFileSystemState,1,1689185761878.cf9b283b4e4ab08db89bfd30836ffc39.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp 2023-07-12 18:16:02,007 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-12 18:16:02,013 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689185761878.6ad0635dded66a2aae707f83fc2af45c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 18:16:02,013 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 6ad0635dded66a2aae707f83fc2af45c, disabling compactions & flushes 2023-07-12 18:16:02,013 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689185761878.6ad0635dded66a2aae707f83fc2af45c. 2023-07-12 18:16:02,013 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689185761878.6ad0635dded66a2aae707f83fc2af45c. 2023-07-12 18:16:02,013 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689185761878.6ad0635dded66a2aae707f83fc2af45c. after waiting 0 ms 2023-07-12 18:16:02,013 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689185761878.6ad0635dded66a2aae707f83fc2af45c. 2023-07-12 18:16:02,013 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689185761878.6ad0635dded66a2aae707f83fc2af45c. 2023-07-12 18:16:02,013 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 6ad0635dded66a2aae707f83fc2af45c: 2023-07-12 18:16:02,014 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689185761878.cf9b283b4e4ab08db89bfd30836ffc39.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 18:16:02,014 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing cf9b283b4e4ab08db89bfd30836ffc39, disabling compactions & flushes 2023-07-12 18:16:02,014 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689185761878.cf9b283b4e4ab08db89bfd30836ffc39. 2023-07-12 18:16:02,014 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689185761878.cf9b283b4e4ab08db89bfd30836ffc39. 2023-07-12 18:16:02,014 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689185761878.cf9b283b4e4ab08db89bfd30836ffc39. after waiting 0 ms 2023-07-12 18:16:02,014 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689185761878.cf9b283b4e4ab08db89bfd30836ffc39. 2023-07-12 18:16:02,014 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689185761878.cf9b283b4e4ab08db89bfd30836ffc39. 2023-07-12 18:16:02,014 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for cf9b283b4e4ab08db89bfd30836ffc39: 2023-07-12 18:16:02,017 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 18:16:02,018 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689185761878.6ad0635dded66a2aae707f83fc2af45c.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689185762018"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689185762018"}]},"ts":"1689185762018"} 2023-07-12 18:16:02,018 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689185761878.cf9b283b4e4ab08db89bfd30836ffc39.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689185762018"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689185762018"}]},"ts":"1689185762018"} 2023-07-12 18:16:02,021 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-12 18:16:02,023 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 18:16:02,023 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689185762023"}]},"ts":"1689185762023"} 2023-07-12 18:16:02,024 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-07-12 18:16:02,029 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-12 18:16:02,032 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 18:16:02,032 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 18:16:02,032 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-12 18:16:02,032 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 18:16:02,032 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=6ad0635dded66a2aae707f83fc2af45c, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=cf9b283b4e4ab08db89bfd30836ffc39, ASSIGN}] 2023-07-12 18:16:02,037 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=cf9b283b4e4ab08db89bfd30836ffc39, ASSIGN 2023-07-12 18:16:02,037 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=6ad0635dded66a2aae707f83fc2af45c, ASSIGN 2023-07-12 18:16:02,038 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=cf9b283b4e4ab08db89bfd30836ffc39, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37689,1689185653014; forceNewPlan=false, retain=false 2023-07-12 18:16:02,038 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=6ad0635dded66a2aae707f83fc2af45c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34493,1689185653159; forceNewPlan=false, retain=false 2023-07-12 18:16:02,188 INFO [jenkins-hbase4:43177] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-12 18:16:02,192 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=cf9b283b4e4ab08db89bfd30836ffc39, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:16:02,193 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689185761878.cf9b283b4e4ab08db89bfd30836ffc39.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689185762192"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689185762192"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689185762192"}]},"ts":"1689185762192"} 2023-07-12 18:16:02,193 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=6ad0635dded66a2aae707f83fc2af45c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:16:02,193 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689185761878.6ad0635dded66a2aae707f83fc2af45c.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689185762193"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689185762193"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689185762193"}]},"ts":"1689185762193"} 2023-07-12 18:16:02,196 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=92, state=RUNNABLE; OpenRegionProcedure cf9b283b4e4ab08db89bfd30836ffc39, server=jenkins-hbase4.apache.org,37689,1689185653014}] 2023-07-12 18:16:02,196 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=91, state=RUNNABLE; OpenRegionProcedure 6ad0635dded66a2aae707f83fc2af45c, server=jenkins-hbase4.apache.org,34493,1689185653159}] 2023-07-12 18:16:02,209 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-12 18:16:02,354 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1689185761878.6ad0635dded66a2aae707f83fc2af45c. 2023-07-12 18:16:02,354 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6ad0635dded66a2aae707f83fc2af45c, NAME => 'testtb-testEmptyExportFileSystemState,,1689185761878.6ad0635dded66a2aae707f83fc2af45c.', STARTKEY => '', ENDKEY => '1'} 2023-07-12 18:16:02,355 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1689185761878.6ad0635dded66a2aae707f83fc2af45c. service=AccessControlService 2023-07-12 18:16:02,355 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 18:16:02,355 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 6ad0635dded66a2aae707f83fc2af45c 2023-07-12 18:16:02,355 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689185761878.6ad0635dded66a2aae707f83fc2af45c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 18:16:02,355 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 6ad0635dded66a2aae707f83fc2af45c 2023-07-12 18:16:02,355 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 6ad0635dded66a2aae707f83fc2af45c 2023-07-12 18:16:02,380 INFO [StoreOpener-6ad0635dded66a2aae707f83fc2af45c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 6ad0635dded66a2aae707f83fc2af45c 2023-07-12 18:16:02,384 DEBUG [StoreOpener-6ad0635dded66a2aae707f83fc2af45c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testEmptyExportFileSystemState/6ad0635dded66a2aae707f83fc2af45c/cf 2023-07-12 18:16:02,384 DEBUG [StoreOpener-6ad0635dded66a2aae707f83fc2af45c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testEmptyExportFileSystemState/6ad0635dded66a2aae707f83fc2af45c/cf 2023-07-12 18:16:02,384 INFO [StoreOpener-6ad0635dded66a2aae707f83fc2af45c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6ad0635dded66a2aae707f83fc2af45c columnFamilyName cf 2023-07-12 18:16:02,385 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1689185761878.cf9b283b4e4ab08db89bfd30836ffc39. 2023-07-12 18:16:02,385 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => cf9b283b4e4ab08db89bfd30836ffc39, NAME => 'testtb-testEmptyExportFileSystemState,1,1689185761878.cf9b283b4e4ab08db89bfd30836ffc39.', STARTKEY => '1', ENDKEY => ''} 2023-07-12 18:16:02,386 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1689185761878.cf9b283b4e4ab08db89bfd30836ffc39. service=AccessControlService 2023-07-12 18:16:02,386 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 18:16:02,386 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState cf9b283b4e4ab08db89bfd30836ffc39 2023-07-12 18:16:02,386 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689185761878.cf9b283b4e4ab08db89bfd30836ffc39.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 18:16:02,386 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for cf9b283b4e4ab08db89bfd30836ffc39 2023-07-12 18:16:02,386 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for cf9b283b4e4ab08db89bfd30836ffc39 2023-07-12 18:16:02,387 INFO [StoreOpener-6ad0635dded66a2aae707f83fc2af45c-1] regionserver.HStore(310): Store=6ad0635dded66a2aae707f83fc2af45c/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 18:16:02,389 INFO [StoreOpener-cf9b283b4e4ab08db89bfd30836ffc39-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region cf9b283b4e4ab08db89bfd30836ffc39 2023-07-12 18:16:02,390 DEBUG [StoreOpener-cf9b283b4e4ab08db89bfd30836ffc39-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testEmptyExportFileSystemState/cf9b283b4e4ab08db89bfd30836ffc39/cf 2023-07-12 18:16:02,390 DEBUG [StoreOpener-cf9b283b4e4ab08db89bfd30836ffc39-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testEmptyExportFileSystemState/cf9b283b4e4ab08db89bfd30836ffc39/cf 2023-07-12 18:16:02,391 INFO [StoreOpener-cf9b283b4e4ab08db89bfd30836ffc39-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cf9b283b4e4ab08db89bfd30836ffc39 columnFamilyName cf 2023-07-12 18:16:02,392 INFO [StoreOpener-cf9b283b4e4ab08db89bfd30836ffc39-1] regionserver.HStore(310): Store=cf9b283b4e4ab08db89bfd30836ffc39/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 18:16:02,392 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testEmptyExportFileSystemState/6ad0635dded66a2aae707f83fc2af45c 2023-07-12 18:16:02,393 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testEmptyExportFileSystemState/cf9b283b4e4ab08db89bfd30836ffc39 2023-07-12 18:16:02,393 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testEmptyExportFileSystemState/6ad0635dded66a2aae707f83fc2af45c 2023-07-12 18:16:02,393 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testEmptyExportFileSystemState/cf9b283b4e4ab08db89bfd30836ffc39 2023-07-12 18:16:02,396 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 6ad0635dded66a2aae707f83fc2af45c 2023-07-12 18:16:02,396 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for cf9b283b4e4ab08db89bfd30836ffc39 2023-07-12 18:16:02,403 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testEmptyExportFileSystemState/6ad0635dded66a2aae707f83fc2af45c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 18:16:02,403 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testEmptyExportFileSystemState/cf9b283b4e4ab08db89bfd30836ffc39/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 18:16:02,403 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 6ad0635dded66a2aae707f83fc2af45c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65137484, jitterRate=-0.029375851154327393}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 18:16:02,403 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 6ad0635dded66a2aae707f83fc2af45c: 2023-07-12 18:16:02,404 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened cf9b283b4e4ab08db89bfd30836ffc39; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65411713, jitterRate=-0.025289520621299744}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 18:16:02,404 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for cf9b283b4e4ab08db89bfd30836ffc39: 2023-07-12 18:16:02,405 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1689185761878.6ad0635dded66a2aae707f83fc2af45c., pid=94, masterSystemTime=1689185762349 2023-07-12 18:16:02,406 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1689185761878.cf9b283b4e4ab08db89bfd30836ffc39., pid=93, masterSystemTime=1689185762349 2023-07-12 18:16:02,408 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=6ad0635dded66a2aae707f83fc2af45c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:16:02,408 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1689185761878.cf9b283b4e4ab08db89bfd30836ffc39. 2023-07-12 18:16:02,408 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1689185761878.6ad0635dded66a2aae707f83fc2af45c.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689185762407"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689185762407"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689185762407"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689185762407"}]},"ts":"1689185762407"} 2023-07-12 18:16:02,408 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1689185761878.cf9b283b4e4ab08db89bfd30836ffc39. 2023-07-12 18:16:02,408 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1689185761878.6ad0635dded66a2aae707f83fc2af45c. 2023-07-12 18:16:02,408 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1689185761878.6ad0635dded66a2aae707f83fc2af45c. 2023-07-12 18:16:02,409 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=cf9b283b4e4ab08db89bfd30836ffc39, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:16:02,409 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1689185761878.cf9b283b4e4ab08db89bfd30836ffc39.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689185762409"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689185762409"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689185762409"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689185762409"}]},"ts":"1689185762409"} 2023-07-12 18:16:02,414 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=91 2023-07-12 18:16:02,415 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=91, state=SUCCESS; OpenRegionProcedure 6ad0635dded66a2aae707f83fc2af45c, server=jenkins-hbase4.apache.org,34493,1689185653159 in 214 msec 2023-07-12 18:16:02,416 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=92 2023-07-12 18:16:02,416 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=92, state=SUCCESS; OpenRegionProcedure cf9b283b4e4ab08db89bfd30836ffc39, server=jenkins-hbase4.apache.org,37689,1689185653014 in 216 msec 2023-07-12 18:16:02,419 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=6ad0635dded66a2aae707f83fc2af45c, ASSIGN in 383 msec 2023-07-12 18:16:02,421 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=92, resume processing ppid=90 2023-07-12 18:16:02,421 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=cf9b283b4e4ab08db89bfd30836ffc39, ASSIGN in 384 msec 2023-07-12 18:16:02,422 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 18:16:02,422 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689185762422"}]},"ts":"1689185762422"} 2023-07-12 18:16:02,423 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-07-12 18:16:02,426 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 18:16:02,426 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-07-12 18:16:02,428 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34493] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-12 18:16:02,430 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 18:16:02,430 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 18:16:02,430 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 18:16:02,430 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 18:16:02,432 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-12 18:16:02,433 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-12 18:16:02,433 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-12 18:16:02,433 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-12 18:16:02,436 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 555 msec 2023-07-12 18:16:02,510 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-12 18:16:02,511 INFO [Listener at jenkins-hbase4.apache.org/41393] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-07-12 18:16:02,516 DEBUG [Listener at jenkins-hbase4.apache.org/41393] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-12 18:16:02,516 DEBUG [Listener at jenkins-hbase4.apache.org/41393] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1689185761878.6ad0635dded66a2aae707f83fc2af45c. 2023-07-12 18:16:02,520 INFO [Listener at jenkins-hbase4.apache.org/41393] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 18:16:02,534 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 18:16:02,534 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689185762534 (current time:1689185762534). 2023-07-12 18:16:02,534 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 18:16:02,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] zookeeper.ReadOnlyZKClient(139): Connect 0x32b332eb to 127.0.0.1:62122 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 18:16:02,544 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@11ea4e68, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 18:16:02,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 18:16:02,553 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58912, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 18:16:02,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x32b332eb to 127.0.0.1:62122 2023-07-12 18:16:02,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 18:16:02,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] zookeeper.ReadOnlyZKClient(139): Connect 0x702b9c09 to 127.0.0.1:62122 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 18:16:02,566 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5b24dc8d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 18:16:02,570 DEBUG [hconnection-0x187e408f-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 18:16:02,571 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58918, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 18:16:02,580 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x702b9c09 to 127.0.0.1:62122 2023-07-12 18:16:02,580 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 18:16:02,580 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-12 18:16:02,581 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 18:16:02,581 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 18:16:02,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-12 18:16:02,585 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-12 18:16:02,586 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689186362586 2023-07-12 18:16:02,587 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-12 18:16:02,586 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 18:16:02,588 DEBUG [Listener at jenkins-hbase4.apache.org/41393] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 18:16:02,588 DEBUG [Listener at jenkins-hbase4.apache.org/41393] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 18:16:02,590 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-12 18:16:02,590 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-12 18:16:02,591 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 7 msec 2023-07-12 18:16:02,594 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-12 18:16:02,595 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689186362595 2023-07-12 18:16:02,604 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:02,604 INFO [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-07-12 18:16:02,604 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 18:16:02,606 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-12 18:16:02,606 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-12 18:16:02,606 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:02,606 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:02,613 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:16:02,613 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:16:02,613 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:16:02,613 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:16:02,613 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:16:02,613 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:16:02,613 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:16:02,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:16:02,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:16:02,613 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:16:02,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:16:02,613 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:16:02,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:02,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:02,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:02,614 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:16:02,614 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:02,614 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 18:16:02,614 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:02,615 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:02,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-12 18:16:02,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:02,615 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-12 18:16:02,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-12 18:16:02,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:02,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-12 18:16:02,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:02,616 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-12 18:16:02,616 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-12 18:16:02,616 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:02,616 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-12 18:16:02,616 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 18:16:02,621 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:02,630 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:02,623 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-12 18:16:02,631 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-12 18:16:02,631 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-12 18:16:02,631 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 18:16:02,631 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-12 18:16:02,633 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-12 18:16:02,631 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 18:16:02,638 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-12 18:16:02,638 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34205,1689185653087' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-12 18:16:02,640 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37689,1689185653014' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-12 18:16:02,640 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-12 18:16:02,641 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-12 18:16:02,641 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34493,1689185653159' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-12 18:16:02,642 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:02,643 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:16:02,643 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:02,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:16:02,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 18:16:02,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 18:16:02,643 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:16:02,643 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:02,644 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:02,644 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:02,644 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 18:16:02,644 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 18:16:02,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 18:16:02,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 18:16:02,644 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:02,644 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 18:16:02,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:02,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:16:02,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:16:02,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:16:02,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 18:16:02,646 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34493,1689185653159' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-12 18:16:02,646 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1fc085ab[Count = 1] remaining members to acquire global barrier 2023-07-12 18:16:02,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:16:02,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 18:16:02,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 18:16:02,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 18:16:02,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 18:16:02,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:02,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:16:02,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:16:02,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:16:02,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 18:16:02,649 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37689,1689185653014' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-12 18:16:02,649 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1fc085ab[Count = 0] remaining members to acquire global barrier 2023-07-12 18:16:02,649 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-12 18:16:02,649 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:02,651 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:02,651 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:02,651 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:02,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:02,651 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:02,651 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-12 18:16:02,651 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:02,651 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-12 18:16:02,651 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,34205,1689185653087' in zk 2023-07-12 18:16:02,651 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:02,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:02,651 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:16:02,651 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-12 18:16:02,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:02,652 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-12 18:16:02,652 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:16:02,652 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 18:16:02,654 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-12 18:16:02,654 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 18:16:02,654 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-12 18:16:02,663 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 18:16:02,665 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 18:16:02,666 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 18:16:02,667 DEBUG [rs(jenkins-hbase4.apache.org,34493,1689185653159)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689185761878.6ad0635dded66a2aae707f83fc2af45c. 2023-07-12 18:16:02,667 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 18:16:02,666 DEBUG [rs(jenkins-hbase4.apache.org,37689,1689185653014)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689185761878.cf9b283b4e4ab08db89bfd30836ffc39. 2023-07-12 18:16:02,667 DEBUG [rs(jenkins-hbase4.apache.org,34493,1689185653159)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689185761878.6ad0635dded66a2aae707f83fc2af45c. started... 2023-07-12 18:16:02,667 DEBUG [rs(jenkins-hbase4.apache.org,37689,1689185653014)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689185761878.cf9b283b4e4ab08db89bfd30836ffc39. started... 2023-07-12 18:16:02,667 DEBUG [rs(jenkins-hbase4.apache.org,34493,1689185653159)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6ad0635dded66a2aae707f83fc2af45c: 2023-07-12 18:16:02,668 DEBUG [rs(jenkins-hbase4.apache.org,37689,1689185653014)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for cf9b283b4e4ab08db89bfd30836ffc39: 2023-07-12 18:16:02,668 DEBUG [rs(jenkins-hbase4.apache.org,34493,1689185653159)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689185761878.6ad0635dded66a2aae707f83fc2af45c.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:02,669 DEBUG [rs(jenkins-hbase4.apache.org,34493,1689185653159)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 18:16:02,669 DEBUG [rs(jenkins-hbase4.apache.org,37689,1689185653014)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689185761878.cf9b283b4e4ab08db89bfd30836ffc39.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:02,669 DEBUG [rs(jenkins-hbase4.apache.org,34493,1689185653159)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 18:16:02,669 DEBUG [rs(jenkins-hbase4.apache.org,37689,1689185653014)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 18:16:02,669 DEBUG [rs(jenkins-hbase4.apache.org,37689,1689185653014)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 18:16:02,689 DEBUG [Listener at jenkins-hbase4.apache.org/41393] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 18:16:02,689 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-12 18:16:02,690 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-12 18:16:02,690 DEBUG [Listener at jenkins-hbase4.apache.org/41393] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 18:16:02,715 DEBUG [rs(jenkins-hbase4.apache.org,37689,1689185653014)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689185761878.cf9b283b4e4ab08db89bfd30836ffc39. completed. 2023-07-12 18:16:02,715 DEBUG [rs(jenkins-hbase4.apache.org,37689,1689185653014)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689185761878.cf9b283b4e4ab08db89bfd30836ffc39. 2023-07-12 18:16:02,715 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 18:16:02,715 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 18:16:02,715 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:16:02,715 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-12 18:16:02,715 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,37689,1689185653014' in zk 2023-07-12 18:16:02,717 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-12 18:16:02,717 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:16:02,717 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 18:16:02,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:16:02,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 18:16:02,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 18:16:02,717 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-12 18:16:02,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 18:16:02,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 18:16:02,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:02,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:16:02,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:16:02,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:16:02,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 18:16:02,724 DEBUG [rs(jenkins-hbase4.apache.org,34493,1689185653159)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689185761878.6ad0635dded66a2aae707f83fc2af45c. completed. 2023-07-12 18:16:02,724 DEBUG [rs(jenkins-hbase4.apache.org,34493,1689185653159)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689185761878.6ad0635dded66a2aae707f83fc2af45c. 2023-07-12 18:16:02,724 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 18:16:02,724 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 18:16:02,724 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:16:02,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:02,724 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-12 18:16:02,724 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,34493,1689185653159' in zk 2023-07-12 18:16:02,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:16:02,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:16:02,726 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-12 18:16:02,726 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 18:16:02,726 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-12 18:16:02,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,37689,1689185653014': 2023-07-12 18:16:02,729 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37689,1689185653014' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-12 18:16:02,729 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:16:02,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:16:02,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 18:16:02,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 18:16:02,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 18:16:02,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 18:16:02,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:02,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:16:02,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:16:02,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:16:02,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 18:16:02,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:02,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:16:02,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:16:02,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:16:02,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,34493,1689185653159': 2023-07-12 18:16:02,741 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34493,1689185653159' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-12 18:16:02,741 INFO [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-07-12 18:16:02,741 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 18:16:02,741 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 18:16:02,741 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:02,741 INFO [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 18:16:02,745 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:02,745 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:02,745 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:02,745 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:02,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:02,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:02,745 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:16:02,745 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:16:02,745 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:02,745 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:16:02,745 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:02,746 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:16:02,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:16:02,745 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:16:02,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:16:02,745 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:02,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:02,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:02,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 18:16:02,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 18:16:02,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:02,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:02,747 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:16:02,747 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:16:02,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:16:02,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 18:16:02,748 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:16:02,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:02,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:02,748 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:16:02,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 18:16:02,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:02,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:16:02,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:16:02,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:16:02,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 18:16:02,752 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:16:02,753 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:16:02,753 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:16:02,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:02,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:16:02,756 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:16:02,756 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:16:02,756 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:16:02,756 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:16:02,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:16:02,756 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:16:02,756 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:16:02,756 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:16:02,757 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 18:16:02,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:16:02,757 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:16:02,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:16:02,756 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:16:02,756 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:16:02,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:16:02,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:16:02,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:16:02,757 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:02,756 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:16:02,759 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-07-12 18:16:02,759 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:16:02,759 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:02,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:16:02,759 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:02,759 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-12 18:16:02,760 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:16:02,760 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:16:02,760 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:02,760 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:16:02,760 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:02,760 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:16:02,760 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:16:02,760 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:02,760 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:02,760 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:16:02,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:16:02,760 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState because node does not exist (not an error) 2023-07-12 18:16:02,765 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-12 18:16:02,790 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:02,791 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:02,817 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:02,859 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-12 18:16:02,859 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:02,859 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:02,859 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689185762587Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1689185762790 (+203 ms)Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689185762790Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1689185762790Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1689185762796 (+6 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689185762810 (+14 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689185762859 (+49 ms) 2023-07-12 18:16:02,864 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-12 18:16:02,866 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 276 msec 2023-07-12 18:16:02,890 DEBUG [Listener at jenkins-hbase4.apache.org/41393] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 18:16:02,891 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-12 18:16:02,891 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 18:16:02,894 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34493] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1689185761878.6ad0635dded66a2aae707f83fc2af45c. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 18:16:02,895 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37689] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1689185761878.cf9b283b4e4ab08db89bfd30836ffc39. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 18:16:02,899 DEBUG [Listener at jenkins-hbase4.apache.org/41393] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-12 18:16:02,899 DEBUG [Listener at jenkins-hbase4.apache.org/41393] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1689185761878.6ad0635dded66a2aae707f83fc2af45c. 2023-07-12 18:16:02,899 INFO [Listener at jenkins-hbase4.apache.org/41393] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 18:16:02,911 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 18:16:02,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689185762911 (current time:1689185762911). 2023-07-12 18:16:02,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 18:16:02,912 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] zookeeper.ReadOnlyZKClient(139): Connect 0x20f5e29b to 127.0.0.1:62122 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 18:16:02,932 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4ae5b432, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 18:16:02,934 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 18:16:02,940 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58922, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 18:16:02,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x20f5e29b to 127.0.0.1:62122 2023-07-12 18:16:02,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 18:16:02,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] zookeeper.ReadOnlyZKClient(139): Connect 0x5e190c33 to 127.0.0.1:62122 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 18:16:02,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@51f7cc51, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 18:16:02,956 DEBUG [hconnection-0x3654b679-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 18:16:02,960 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58928, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 18:16:02,970 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5e190c33 to 127.0.0.1:62122 2023-07-12 18:16:02,970 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 18:16:02,970 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-12 18:16:02,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 18:16:02,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 18:16:02,973 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-12 18:16:02,975 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-12 18:16:02,976 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689186362976 2023-07-12 18:16:02,976 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-12 18:16:02,976 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 18:16:02,977 DEBUG [Listener at jenkins-hbase4.apache.org/41393] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 18:16:02,977 DEBUG [Listener at jenkins-hbase4.apache.org/41393] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 18:16:02,979 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-12 18:16:02,979 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-12 18:16:02,980 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-07-12 18:16:02,981 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-12 18:16:02,982 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689186362982 2023-07-12 18:16:03,004 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:03,004 INFO [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-07-12 18:16:03,004 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 18:16:03,006 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-12 18:16:03,006 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-12 18:16:03,074 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:03,074 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:03,075 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:16:03,075 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:16:03,075 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:16:03,075 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:16:03,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:16:03,075 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:16:03,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:16:03,075 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:16:03,076 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:16:03,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:16:03,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:03,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:03,076 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:16:03,076 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:16:03,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:03,076 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:03,077 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:16:03,077 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 18:16:03,077 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:03,077 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:03,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-12 18:16:03,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:03,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-12 18:16:03,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:03,077 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-12 18:16:03,077 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-12 18:16:03,077 DEBUG [Listener at jenkins-hbase4.apache.org/41393] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 18:16:03,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-12 18:16:03,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:03,078 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-12 18:16:03,078 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-12 18:16:03,078 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-12 18:16:03,079 DEBUG [Listener at jenkins-hbase4.apache.org/41393] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 18:16:03,082 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:03,083 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-12 18:16:03,083 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 18:16:03,088 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-12 18:16:03,088 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-12 18:16:03,088 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34205,1689185653087' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-12 18:16:03,091 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:03,091 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:03,092 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 18:16:03,094 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:03,094 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:03,095 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-12 18:16:03,095 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-12 18:16:03,095 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 18:16:03,095 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 18:16:03,099 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-12 18:16:03,099 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-12 18:16:03,099 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37689,1689185653014' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-12 18:16:03,099 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-12 18:16:03,099 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-12 18:16:03,099 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34493,1689185653159' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-12 18:16:03,101 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:16:03,101 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:03,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:16:03,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 18:16:03,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 18:16:03,102 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:16:03,102 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:03,102 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:03,102 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 18:16:03,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 18:16:03,103 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:03,103 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 18:16:03,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 18:16:03,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:03,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:16:03,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:16:03,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:16:03,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 18:16:03,105 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34493,1689185653159' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-12 18:16:03,105 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7318c0e5[Count = 1] remaining members to acquire global barrier 2023-07-12 18:16:03,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:16:03,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 18:16:03,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 18:16:03,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 18:16:03,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 18:16:03,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:03,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:16:03,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:16:03,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:16:03,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 18:16:03,107 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37689,1689185653014' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-12 18:16:03,107 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7318c0e5[Count = 0] remaining members to acquire global barrier 2023-07-12 18:16:03,107 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-12 18:16:03,107 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:03,112 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:03,112 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:03,112 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:03,112 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:03,112 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:03,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:03,112 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:03,113 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-12 18:16:03,113 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:16:03,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:03,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:03,113 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-12 18:16:03,113 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-12 18:16:03,113 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-12 18:16:03,113 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,34205,1689185653087' in zk 2023-07-12 18:16:03,113 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:16:03,113 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 18:16:03,114 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 18:16:03,114 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 18:16:03,115 DEBUG [rs(jenkins-hbase4.apache.org,37689,1689185653014)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689185761878.cf9b283b4e4ab08db89bfd30836ffc39. 2023-07-12 18:16:03,115 DEBUG [rs(jenkins-hbase4.apache.org,37689,1689185653014)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689185761878.cf9b283b4e4ab08db89bfd30836ffc39. started... 2023-07-12 18:16:03,115 INFO [rs(jenkins-hbase4.apache.org,37689,1689185653014)-snapshot-pool-0] regionserver.HRegion(2745): Flushing cf9b283b4e4ab08db89bfd30836ffc39 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-07-12 18:16:03,116 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-12 18:16:03,116 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 18:16:03,116 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-12 18:16:03,120 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 18:16:03,120 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 18:16:03,134 DEBUG [rs(jenkins-hbase4.apache.org,34493,1689185653159)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689185761878.6ad0635dded66a2aae707f83fc2af45c. 2023-07-12 18:16:03,135 DEBUG [rs(jenkins-hbase4.apache.org,34493,1689185653159)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689185761878.6ad0635dded66a2aae707f83fc2af45c. started... 2023-07-12 18:16:03,135 INFO [rs(jenkins-hbase4.apache.org,34493,1689185653159)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 6ad0635dded66a2aae707f83fc2af45c 1/1 column families, dataSize=333 B heapSize=976 B 2023-07-12 18:16:03,166 INFO [rs(jenkins-hbase4.apache.org,37689,1689185653014)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202307123a65f59a48f549dc83e3864be4535ffa to hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202307123a65f59a48f549dc83e3864be4535ffa 2023-07-12 18:16:03,196 INFO [rs(jenkins-hbase4.apache.org,37689,1689185653014)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testEmptyExportFileSystemState/cf9b283b4e4ab08db89bfd30836ffc39/.tmp/cf/ce1f684261ad45da879e3439c9886e82 2023-07-12 18:16:03,197 INFO [rs(jenkins-hbase4.apache.org,34493,1689185653159)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230712a5f8339b17724f8396d97ad5196c2e49 to hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230712a5f8339b17724f8396d97ad5196c2e49 2023-07-12 18:16:03,201 DEBUG [rs(jenkins-hbase4.apache.org,37689,1689185653014)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testEmptyExportFileSystemState/cf9b283b4e4ab08db89bfd30836ffc39/.tmp/cf/ce1f684261ad45da879e3439c9886e82 as hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testEmptyExportFileSystemState/cf9b283b4e4ab08db89bfd30836ffc39/cf/ce1f684261ad45da879e3439c9886e82 2023-07-12 18:16:03,205 INFO [rs(jenkins-hbase4.apache.org,34493,1689185653159)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testEmptyExportFileSystemState/6ad0635dded66a2aae707f83fc2af45c/.tmp/cf/9ad427f678614d85bd08b41767e9f44b 2023-07-12 18:16:03,207 INFO [rs(jenkins-hbase4.apache.org,37689,1689185653014)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testEmptyExportFileSystemState/cf9b283b4e4ab08db89bfd30836ffc39/cf/ce1f684261ad45da879e3439c9886e82, entries=45, sequenceid=6, filesize=12.7 K 2023-07-12 18:16:03,208 INFO [rs(jenkins-hbase4.apache.org,37689,1689185653014)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for cf9b283b4e4ab08db89bfd30836ffc39 in 93ms, sequenceid=6, compaction requested=false 2023-07-12 18:16:03,208 DEBUG [rs(jenkins-hbase4.apache.org,37689,1689185653014)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-07-12 18:16:03,209 DEBUG [rs(jenkins-hbase4.apache.org,37689,1689185653014)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for cf9b283b4e4ab08db89bfd30836ffc39: 2023-07-12 18:16:03,209 DEBUG [rs(jenkins-hbase4.apache.org,37689,1689185653014)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689185761878.cf9b283b4e4ab08db89bfd30836ffc39.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:03,209 DEBUG [rs(jenkins-hbase4.apache.org,37689,1689185653014)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 18:16:03,209 DEBUG [rs(jenkins-hbase4.apache.org,37689,1689185653014)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testEmptyExportFileSystemState/cf9b283b4e4ab08db89bfd30836ffc39/cf/ce1f684261ad45da879e3439c9886e82] hfiles 2023-07-12 18:16:03,209 DEBUG [rs(jenkins-hbase4.apache.org,37689,1689185653014)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testEmptyExportFileSystemState/cf9b283b4e4ab08db89bfd30836ffc39/cf/ce1f684261ad45da879e3439c9886e82 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:03,211 DEBUG [rs(jenkins-hbase4.apache.org,34493,1689185653159)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testEmptyExportFileSystemState/6ad0635dded66a2aae707f83fc2af45c/.tmp/cf/9ad427f678614d85bd08b41767e9f44b as hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testEmptyExportFileSystemState/6ad0635dded66a2aae707f83fc2af45c/cf/9ad427f678614d85bd08b41767e9f44b 2023-07-12 18:16:03,215 INFO [rs(jenkins-hbase4.apache.org,34493,1689185653159)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testEmptyExportFileSystemState/6ad0635dded66a2aae707f83fc2af45c/cf/9ad427f678614d85bd08b41767e9f44b, entries=5, sequenceid=6, filesize=5.8 K 2023-07-12 18:16:03,216 INFO [rs(jenkins-hbase4.apache.org,34493,1689185653159)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for 6ad0635dded66a2aae707f83fc2af45c in 81ms, sequenceid=6, compaction requested=false 2023-07-12 18:16:03,224 DEBUG [rs(jenkins-hbase4.apache.org,34493,1689185653159)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6ad0635dded66a2aae707f83fc2af45c: 2023-07-12 18:16:03,224 DEBUG [rs(jenkins-hbase4.apache.org,34493,1689185653159)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689185761878.6ad0635dded66a2aae707f83fc2af45c.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:03,226 DEBUG [rs(jenkins-hbase4.apache.org,34493,1689185653159)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 18:16:03,226 DEBUG [rs(jenkins-hbase4.apache.org,34493,1689185653159)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testEmptyExportFileSystemState/6ad0635dded66a2aae707f83fc2af45c/cf/9ad427f678614d85bd08b41767e9f44b] hfiles 2023-07-12 18:16:03,226 DEBUG [rs(jenkins-hbase4.apache.org,34493,1689185653159)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testEmptyExportFileSystemState/6ad0635dded66a2aae707f83fc2af45c/cf/9ad427f678614d85bd08b41767e9f44b for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:03,230 DEBUG [rs(jenkins-hbase4.apache.org,37689,1689185653014)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689185761878.cf9b283b4e4ab08db89bfd30836ffc39. completed. 2023-07-12 18:16:03,231 DEBUG [rs(jenkins-hbase4.apache.org,37689,1689185653014)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689185761878.cf9b283b4e4ab08db89bfd30836ffc39. 2023-07-12 18:16:03,231 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 18:16:03,231 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 18:16:03,231 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:16:03,231 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-12 18:16:03,231 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,37689,1689185653014' in zk 2023-07-12 18:16:03,233 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:16:03,233 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-12 18:16:03,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:16:03,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 18:16:03,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 18:16:03,233 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 18:16:03,233 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-12 18:16:03,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 18:16:03,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 18:16:03,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:03,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:16:03,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:16:03,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:16:03,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 18:16:03,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:03,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:16:03,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:16:03,238 DEBUG [rs(jenkins-hbase4.apache.org,34493,1689185653159)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689185761878.6ad0635dded66a2aae707f83fc2af45c. completed. 2023-07-12 18:16:03,239 DEBUG [rs(jenkins-hbase4.apache.org,34493,1689185653159)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689185761878.6ad0635dded66a2aae707f83fc2af45c. 2023-07-12 18:16:03,239 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 18:16:03,239 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 18:16:03,239 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:16:03,239 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-12 18:16:03,239 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,34493,1689185653159' in zk 2023-07-12 18:16:03,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,37689,1689185653014': 2023-07-12 18:16:03,241 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37689,1689185653014' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-12 18:16:03,242 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:16:03,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:16:03,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 18:16:03,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 18:16:03,242 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-12 18:16:03,242 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 18:16:03,242 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-12 18:16:03,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 18:16:03,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 18:16:03,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:03,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:16:03,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:16:03,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:16:03,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 18:16:03,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:03,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:16:03,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:16:03,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:16:03,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,34493,1689185653159': 2023-07-12 18:16:03,248 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34493,1689185653159' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-12 18:16:03,248 INFO [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-07-12 18:16:03,248 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 18:16:03,248 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 18:16:03,248 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:03,248 INFO [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 18:16:03,250 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:03,250 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:03,250 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:03,250 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:03,250 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:03,250 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:03,250 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:16:03,250 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:16:03,250 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:03,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:03,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:03,250 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:16:03,250 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:16:03,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:03,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:03,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 18:16:03,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 18:16:03,251 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:16:03,251 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:16:03,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:16:03,251 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:16:03,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:16:03,251 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:16:03,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:16:03,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 18:16:03,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:03,251 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:16:03,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:03,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:03,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:03,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 18:16:03,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:03,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:16:03,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:16:03,253 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:16:03,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:16:03,254 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:16:03,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 18:16:03,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:03,254 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:16:03,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:16:03,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:16:03,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:16:03,258 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:16:03,258 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:03,258 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:16:03,259 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:16:03,259 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:16:03,258 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:16:03,259 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 18:16:03,259 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:16:03,258 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:16:03,260 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:03,259 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:16:03,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:16:03,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:16:03,259 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:16:03,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:16:03,259 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:16:03,259 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:16:03,261 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-07-12 18:16:03,260 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:16:03,261 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:03,261 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:16:03,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:16:03,261 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:16:03,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:16:03,261 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:03,261 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-12 18:16:03,261 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:16:03,262 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:03,262 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:16:03,262 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:16:03,262 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:03,262 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:03,263 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202307123a65f59a48f549dc83e3864be4535ffa, hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230712a5f8339b17724f8396d97ad5196c2e49] mob files 2023-07-12 18:16:03,263 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202307123a65f59a48f549dc83e3864be4535ffa 2023-07-12 18:16:03,263 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230712a5f8339b17724f8396d97ad5196c2e49 2023-07-12 18:16:03,275 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:16:03,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:16:03,279 DEBUG [Listener at jenkins-hbase4.apache.org/41393] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 18:16:03,281 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-12 18:16:03,281 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-12 18:16:03,283 DEBUG [Listener at jenkins-hbase4.apache.org/41393] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-12 18:16:03,322 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:03,323 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:03,420 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:03,527 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-12 18:16:03,527 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:03,528 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:03,528 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689185762976Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1689185763322 (+346 ms)Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1689185763322Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1689185763322Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1689185763334 (+12 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1689185763392 (+58 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689185763527 (+135 ms) 2023-07-12 18:16:03,535 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-12 18:16:03,537 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 558 msec 2023-07-12 18:16:03,583 DEBUG [Listener at jenkins-hbase4.apache.org/41393] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 18:16:03,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-12 18:16:03,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 18:16:03,584 INFO [Listener at jenkins-hbase4.apache.org/41393] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/export-test/export-1689185763584 2023-07-12 18:16:03,585 INFO [Listener at jenkins-hbase4.apache.org/41393] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:38679, tgtDir=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/export-test/export-1689185763584, rawTgtDir=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/export-test/export-1689185763584, srcFsUri=hdfs://localhost:38679, srcDir=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0 2023-07-12 18:16:03,646 DEBUG [Listener at jenkins-hbase4.apache.org/41393] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:38679, inputRoot=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0 2023-07-12 18:16:03,646 DEBUG [Listener at jenkins-hbase4.apache.org/41393] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_533359465_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/export-test/export-1689185763584, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/export-test/export-1689185763584/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:03,646 INFO [Listener at jenkins-hbase4.apache.org/41393] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:38679, inputRoot=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0, snapshotDir=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-07-12 18:16:03,675 INFO [Listener at jenkins-hbase4.apache.org/41393] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/export-test/export-1689185763584/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:03,844 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-12 18:16:03,844 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-12 18:16:03,845 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-12 18:16:03,845 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-12 18:16:04,933 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/908563f7-ecc5-f8cf-2e08-f8e1a8353ad0/hadoop-8358401568642587891.jar 2023-07-12 18:16:04,933 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-12 18:16:04,934 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-12 18:16:05,004 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/908563f7-ecc5-f8cf-2e08-f8e1a8353ad0/hadoop-4055749902379537827.jar 2023-07-12 18:16:05,005 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-12 18:16:05,005 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-12 18:16:05,006 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-12 18:16:05,006 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-12 18:16:05,007 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-12 18:16:05,007 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-12 18:16:05,007 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-12 18:16:05,008 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-12 18:16:05,008 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-12 18:16:05,009 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-12 18:16:05,009 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-12 18:16:05,009 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-12 18:16:05,010 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-12 18:16:05,010 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-12 18:16:05,010 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-12 18:16:05,011 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-12 18:16:05,012 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 18:16:05,012 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 18:16:05,013 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 18:16:05,013 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 18:16:05,013 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 18:16:05,014 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 18:16:05,014 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 18:16:05,218 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689185662417_0005_000001 (auth:SIMPLE) 2023-07-12 18:16:06,451 WARN [Listener at jenkins-hbase4.apache.org/41393] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-12 18:16:06,454 INFO [Listener at jenkins-hbase4.apache.org/41393] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-07-12 18:16:06,728 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 18:16:06,728 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 18:16:06,749 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-12 18:16:06,874 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689185662417_0006_000001 (auth:SIMPLE) 2023-07-12 18:16:12,335 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689185662417_0006_000001 (auth:SIMPLE) 2023-07-12 18:16:16,056 INFO [Listener at jenkins-hbase4.apache.org/41393] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-12 18:16:16,057 INFO [Listener at jenkins-hbase4.apache.org/41393] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-12 18:16:16,076 INFO [Listener at jenkins-hbase4.apache.org/41393] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:16,076 INFO [Listener at jenkins-hbase4.apache.org/41393] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-12 18:16:16,077 INFO [Listener at jenkins-hbase4.apache.org/41393] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-12 18:16:16,077 DEBUG [Listener at jenkins-hbase4.apache.org/41393] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-639947816_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:16,078 DEBUG [Listener at jenkins-hbase4.apache.org/41393] snapshot.TestExportSnapshot(367): hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-12 18:16:16,078 DEBUG [Listener at jenkins-hbase4.apache.org/41393] snapshot.TestExportSnapshot(367): hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-12 18:16:16,078 DEBUG [Listener at jenkins-hbase4.apache.org/41393] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-639947816_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/export-test/export-1689185763584/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/export-test/export-1689185763584/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:16,078 DEBUG [Listener at jenkins-hbase4.apache.org/41393] snapshot.TestExportSnapshot(367): hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/export-test/export-1689185763584/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-12 18:16:16,079 DEBUG [Listener at jenkins-hbase4.apache.org/41393] snapshot.TestExportSnapshot(367): hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/export-test/export-1689185763584/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-12 18:16:16,087 INFO [Listener at jenkins-hbase4.apache.org/41393] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-07-12 18:16:16,087 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-07-12 18:16:16,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] procedure2.ProcedureExecutor(1029): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-12 18:16:16,094 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689185776093"}]},"ts":"1689185776093"} 2023-07-12 18:16:16,095 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-07-12 18:16:16,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-12 18:16:16,098 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-07-12 18:16:16,099 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=6ad0635dded66a2aae707f83fc2af45c, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=cf9b283b4e4ab08db89bfd30836ffc39, UNASSIGN}] 2023-07-12 18:16:16,100 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=cf9b283b4e4ab08db89bfd30836ffc39, UNASSIGN 2023-07-12 18:16:16,102 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=6ad0635dded66a2aae707f83fc2af45c, UNASSIGN 2023-07-12 18:16:16,103 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=cf9b283b4e4ab08db89bfd30836ffc39, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:16:16,103 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689185761878.cf9b283b4e4ab08db89bfd30836ffc39.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689185776103"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689185776103"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689185776103"}]},"ts":"1689185776103"} 2023-07-12 18:16:16,104 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=6ad0635dded66a2aae707f83fc2af45c, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:16:16,104 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689185761878.6ad0635dded66a2aae707f83fc2af45c.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689185776104"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689185776104"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689185776104"}]},"ts":"1689185776104"} 2023-07-12 18:16:16,106 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=101, state=RUNNABLE; CloseRegionProcedure cf9b283b4e4ab08db89bfd30836ffc39, server=jenkins-hbase4.apache.org,37689,1689185653014}] 2023-07-12 18:16:16,106 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=100, state=RUNNABLE; CloseRegionProcedure 6ad0635dded66a2aae707f83fc2af45c, server=jenkins-hbase4.apache.org,34493,1689185653159}] 2023-07-12 18:16:16,199 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-12 18:16:16,258 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 6ad0635dded66a2aae707f83fc2af45c 2023-07-12 18:16:16,259 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 6ad0635dded66a2aae707f83fc2af45c, disabling compactions & flushes 2023-07-12 18:16:16,259 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689185761878.6ad0635dded66a2aae707f83fc2af45c. 2023-07-12 18:16:16,259 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689185761878.6ad0635dded66a2aae707f83fc2af45c. 2023-07-12 18:16:16,259 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689185761878.6ad0635dded66a2aae707f83fc2af45c. after waiting 0 ms 2023-07-12 18:16:16,259 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689185761878.6ad0635dded66a2aae707f83fc2af45c. 2023-07-12 18:16:16,259 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close cf9b283b4e4ab08db89bfd30836ffc39 2023-07-12 18:16:16,259 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing cf9b283b4e4ab08db89bfd30836ffc39, disabling compactions & flushes 2023-07-12 18:16:16,259 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689185761878.cf9b283b4e4ab08db89bfd30836ffc39. 2023-07-12 18:16:16,259 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689185761878.cf9b283b4e4ab08db89bfd30836ffc39. 2023-07-12 18:16:16,259 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689185761878.cf9b283b4e4ab08db89bfd30836ffc39. after waiting 0 ms 2023-07-12 18:16:16,259 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689185761878.cf9b283b4e4ab08db89bfd30836ffc39. 2023-07-12 18:16:16,283 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testEmptyExportFileSystemState/6ad0635dded66a2aae707f83fc2af45c/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 18:16:16,284 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 18:16:16,285 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689185761878.6ad0635dded66a2aae707f83fc2af45c. 2023-07-12 18:16:16,285 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 6ad0635dded66a2aae707f83fc2af45c: 2023-07-12 18:16:16,285 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testEmptyExportFileSystemState/cf9b283b4e4ab08db89bfd30836ffc39/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 18:16:16,285 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 18:16:16,287 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689185761878.cf9b283b4e4ab08db89bfd30836ffc39. 2023-07-12 18:16:16,287 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for cf9b283b4e4ab08db89bfd30836ffc39: 2023-07-12 18:16:16,288 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 6ad0635dded66a2aae707f83fc2af45c 2023-07-12 18:16:16,289 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=6ad0635dded66a2aae707f83fc2af45c, regionState=CLOSED 2023-07-12 18:16:16,289 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689185761878.6ad0635dded66a2aae707f83fc2af45c.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689185776289"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689185776289"}]},"ts":"1689185776289"} 2023-07-12 18:16:16,289 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed cf9b283b4e4ab08db89bfd30836ffc39 2023-07-12 18:16:16,290 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=cf9b283b4e4ab08db89bfd30836ffc39, regionState=CLOSED 2023-07-12 18:16:16,290 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689185761878.cf9b283b4e4ab08db89bfd30836ffc39.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689185776290"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689185776290"}]},"ts":"1689185776290"} 2023-07-12 18:16:16,299 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=101 2023-07-12 18:16:16,299 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=100 2023-07-12 18:16:16,300 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=101, state=SUCCESS; CloseRegionProcedure cf9b283b4e4ab08db89bfd30836ffc39, server=jenkins-hbase4.apache.org,37689,1689185653014 in 186 msec 2023-07-12 18:16:16,300 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=100, state=SUCCESS; CloseRegionProcedure 6ad0635dded66a2aae707f83fc2af45c, server=jenkins-hbase4.apache.org,34493,1689185653159 in 185 msec 2023-07-12 18:16:16,301 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=cf9b283b4e4ab08db89bfd30836ffc39, UNASSIGN in 201 msec 2023-07-12 18:16:16,301 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=100, resume processing ppid=99 2023-07-12 18:16:16,301 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=6ad0635dded66a2aae707f83fc2af45c, UNASSIGN in 201 msec 2023-07-12 18:16:16,302 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689185776302"}]},"ts":"1689185776302"} 2023-07-12 18:16:16,303 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-07-12 18:16:16,305 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-07-12 18:16:16,312 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 221 msec 2023-07-12 18:16:16,400 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-12 18:16:16,400 INFO [Listener at jenkins-hbase4.apache.org/41393] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-07-12 18:16:16,401 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-07-12 18:16:16,402 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-12 18:16:16,405 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-12 18:16:16,405 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-07-12 18:16:16,405 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-12 18:16:16,407 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34493] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-07-12 18:16:16,411 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-12 18:16:16,411 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-12 18:16:16,411 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-12 18:16:16,411 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-12 18:16:16,411 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testEmptyExportFileSystemState/cf9b283b4e4ab08db89bfd30836ffc39 2023-07-12 18:16:16,411 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-12 18:16:16,411 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-12 18:16:16,411 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testEmptyExportFileSystemState/6ad0635dded66a2aae707f83fc2af45c 2023-07-12 18:16:16,411 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-12 18:16:16,411 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-12 18:16:16,413 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-12 18:16:16,413 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 18:16:16,413 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-12 18:16:16,413 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-12 18:16:16,413 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 18:16:16,413 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 18:16:16,413 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-12 18:16:16,413 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 18:16:16,414 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testEmptyExportFileSystemState/cf9b283b4e4ab08db89bfd30836ffc39/cf, FileablePath, hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testEmptyExportFileSystemState/cf9b283b4e4ab08db89bfd30836ffc39/recovered.edits] 2023-07-12 18:16:16,414 DEBUG [HFileArchiver-21] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testEmptyExportFileSystemState/6ad0635dded66a2aae707f83fc2af45c/cf, FileablePath, hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testEmptyExportFileSystemState/6ad0635dded66a2aae707f83fc2af45c/recovered.edits] 2023-07-12 18:16:16,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-12 18:16:16,419 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testEmptyExportFileSystemState/cf9b283b4e4ab08db89bfd30836ffc39/cf/ce1f684261ad45da879e3439c9886e82 to hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/archive/data/default/testtb-testEmptyExportFileSystemState/cf9b283b4e4ab08db89bfd30836ffc39/cf/ce1f684261ad45da879e3439c9886e82 2023-07-12 18:16:16,419 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testEmptyExportFileSystemState/6ad0635dded66a2aae707f83fc2af45c/cf/9ad427f678614d85bd08b41767e9f44b to hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/archive/data/default/testtb-testEmptyExportFileSystemState/6ad0635dded66a2aae707f83fc2af45c/cf/9ad427f678614d85bd08b41767e9f44b 2023-07-12 18:16:16,423 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testEmptyExportFileSystemState/cf9b283b4e4ab08db89bfd30836ffc39/recovered.edits/9.seqid to hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/archive/data/default/testtb-testEmptyExportFileSystemState/cf9b283b4e4ab08db89bfd30836ffc39/recovered.edits/9.seqid 2023-07-12 18:16:16,423 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testEmptyExportFileSystemState/6ad0635dded66a2aae707f83fc2af45c/recovered.edits/9.seqid to hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/archive/data/default/testtb-testEmptyExportFileSystemState/6ad0635dded66a2aae707f83fc2af45c/recovered.edits/9.seqid 2023-07-12 18:16:16,423 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testEmptyExportFileSystemState/cf9b283b4e4ab08db89bfd30836ffc39 2023-07-12 18:16:16,424 DEBUG [HFileArchiver-21] backup.HFileArchiver(596): Deleted hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testEmptyExportFileSystemState/6ad0635dded66a2aae707f83fc2af45c 2023-07-12 18:16:16,424 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-12 18:16:16,424 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-07-12 18:16:16,425 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf] 2023-07-12 18:16:16,430 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202307123a65f59a48f549dc83e3864be4535ffa to hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202307123a65f59a48f549dc83e3864be4535ffa 2023-07-12 18:16:16,431 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230712a5f8339b17724f8396d97ad5196c2e49 to hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230712a5f8339b17724f8396d97ad5196c2e49 2023-07-12 18:16:16,432 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-07-12 18:16:16,434 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-12 18:16:16,437 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-07-12 18:16:16,440 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-07-12 18:16:16,444 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-12 18:16:16,444 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-07-12 18:16:16,444 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1689185761878.6ad0635dded66a2aae707f83fc2af45c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689185776444"}]},"ts":"9223372036854775807"} 2023-07-12 18:16:16,444 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1689185761878.cf9b283b4e4ab08db89bfd30836ffc39.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689185776444"}]},"ts":"9223372036854775807"} 2023-07-12 18:16:16,451 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-12 18:16:16,451 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 6ad0635dded66a2aae707f83fc2af45c, NAME => 'testtb-testEmptyExportFileSystemState,,1689185761878.6ad0635dded66a2aae707f83fc2af45c.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => cf9b283b4e4ab08db89bfd30836ffc39, NAME => 'testtb-testEmptyExportFileSystemState,1,1689185761878.cf9b283b4e4ab08db89bfd30836ffc39.', STARTKEY => '1', ENDKEY => ''}] 2023-07-12 18:16:16,451 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-07-12 18:16:16,451 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689185776451"}]},"ts":"9223372036854775807"} 2023-07-12 18:16:16,453 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-07-12 18:16:16,455 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-12 18:16:16,457 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 54 msec 2023-07-12 18:16:16,516 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-12 18:16:16,516 INFO [Listener at jenkins-hbase4.apache.org/41393] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-07-12 18:16:16,523 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-07-12 18:16:16,525 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:16,526 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-07-12 18:16:16,528 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:16,557 INFO [Listener at jenkins-hbase4.apache.org/41393] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=763 (was 759) Potentially hanging thread: HFileArchiver-21 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x30e4ce87-shared-pool-37 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-639947816_17 at /127.0.0.1:58642 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-639947816_17 at /127.0.0.1:35078 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1982117521_1 at /127.0.0.1:35046 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x30e4ce87-shared-pool-38 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4912 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1506713691) connection to jenkins-hbase4.apache.org/172.31.14.131:33729 from appattempt_1689185662417_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x30e4ce87-shared-pool-39 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x30e4ce87-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1506713691) connection to jenkins-hbase4.apache.org/172.31.14.131:45405 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-639947816_17 at /127.0.0.1:50956 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=916 (was 906) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=657 (was 597) - SystemLoadAverage LEAK? -, ProcessCount=179 (was 179), AvailableMemoryMB=3574 (was 3701) 2023-07-12 18:16:16,557 WARN [Listener at jenkins-hbase4.apache.org/41393] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-07-12 18:16:16,581 INFO [Listener at jenkins-hbase4.apache.org/41393] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=763, OpenFileDescriptor=916, MaxFileDescriptor=60000, SystemLoadAverage=657, ProcessCount=179, AvailableMemoryMB=3571 2023-07-12 18:16:16,581 WARN [Listener at jenkins-hbase4.apache.org/41393] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-07-12 18:16:16,583 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-12 18:16:16,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:16,586 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 18:16:16,586 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-07-12 18:16:16,587 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 18:16:16,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-12 18:16:16,589 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ddf42eebe612bf8fe9e9c04635955f45 2023-07-12 18:16:16,589 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6cce2f63d2810edc9a3c8e684b3764c3 2023-07-12 18:16:16,590 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ddf42eebe612bf8fe9e9c04635955f45 empty. 2023-07-12 18:16:16,590 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6cce2f63d2810edc9a3c8e684b3764c3 empty. 2023-07-12 18:16:16,590 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ddf42eebe612bf8fe9e9c04635955f45 2023-07-12 18:16:16,591 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6cce2f63d2810edc9a3c8e684b3764c3 2023-07-12 18:16:16,591 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-12 18:16:16,602 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-07-12 18:16:16,606 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => ddf42eebe612bf8fe9e9c04635955f45, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689185776582.ddf42eebe612bf8fe9e9c04635955f45.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp 2023-07-12 18:16:16,607 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => 6cce2f63d2810edc9a3c8e684b3764c3, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689185776582.6cce2f63d2810edc9a3c8e684b3764c3.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp 2023-07-12 18:16:16,630 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689185776582.ddf42eebe612bf8fe9e9c04635955f45.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 18:16:16,630 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing ddf42eebe612bf8fe9e9c04635955f45, disabling compactions & flushes 2023-07-12 18:16:16,630 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689185776582.ddf42eebe612bf8fe9e9c04635955f45. 2023-07-12 18:16:16,633 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689185776582.ddf42eebe612bf8fe9e9c04635955f45. 2023-07-12 18:16:16,633 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689185776582.ddf42eebe612bf8fe9e9c04635955f45. after waiting 0 ms 2023-07-12 18:16:16,633 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689185776582.ddf42eebe612bf8fe9e9c04635955f45. 2023-07-12 18:16:16,633 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689185776582.ddf42eebe612bf8fe9e9c04635955f45. 2023-07-12 18:16:16,633 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for ddf42eebe612bf8fe9e9c04635955f45: 2023-07-12 18:16:16,635 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689185776582.6cce2f63d2810edc9a3c8e684b3764c3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 18:16:16,635 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing 6cce2f63d2810edc9a3c8e684b3764c3, disabling compactions & flushes 2023-07-12 18:16:16,635 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689185776582.6cce2f63d2810edc9a3c8e684b3764c3. 2023-07-12 18:16:16,635 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689185776582.6cce2f63d2810edc9a3c8e684b3764c3. 2023-07-12 18:16:16,635 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689185776582.6cce2f63d2810edc9a3c8e684b3764c3. after waiting 0 ms 2023-07-12 18:16:16,635 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689185776582.6cce2f63d2810edc9a3c8e684b3764c3. 2023-07-12 18:16:16,635 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689185776582.6cce2f63d2810edc9a3c8e684b3764c3. 2023-07-12 18:16:16,635 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for 6cce2f63d2810edc9a3c8e684b3764c3: 2023-07-12 18:16:16,637 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 18:16:16,638 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689185776582.ddf42eebe612bf8fe9e9c04635955f45.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689185776638"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689185776638"}]},"ts":"1689185776638"} 2023-07-12 18:16:16,638 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689185776582.6cce2f63d2810edc9a3c8e684b3764c3.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689185776638"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689185776638"}]},"ts":"1689185776638"} 2023-07-12 18:16:16,640 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-12 18:16:16,641 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 18:16:16,641 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689185776641"}]},"ts":"1689185776641"} 2023-07-12 18:16:16,642 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-07-12 18:16:16,647 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-12 18:16:16,648 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 18:16:16,648 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 18:16:16,648 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-12 18:16:16,648 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 18:16:16,648 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=ddf42eebe612bf8fe9e9c04635955f45, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=6cce2f63d2810edc9a3c8e684b3764c3, ASSIGN}] 2023-07-12 18:16:16,651 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=6cce2f63d2810edc9a3c8e684b3764c3, ASSIGN 2023-07-12 18:16:16,651 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=ddf42eebe612bf8fe9e9c04635955f45, ASSIGN 2023-07-12 18:16:16,651 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=6cce2f63d2810edc9a3c8e684b3764c3, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37689,1689185653014; forceNewPlan=false, retain=false 2023-07-12 18:16:16,651 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=ddf42eebe612bf8fe9e9c04635955f45, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34493,1689185653159; forceNewPlan=false, retain=false 2023-07-12 18:16:16,688 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-12 18:16:16,802 INFO [jenkins-hbase4:43177] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-12 18:16:16,805 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=6cce2f63d2810edc9a3c8e684b3764c3, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:16:16,805 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689185776582.6cce2f63d2810edc9a3c8e684b3764c3.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689185776805"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689185776805"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689185776805"}]},"ts":"1689185776805"} 2023-07-12 18:16:16,806 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=ddf42eebe612bf8fe9e9c04635955f45, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:16:16,806 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689185776582.ddf42eebe612bf8fe9e9c04635955f45.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689185776806"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689185776806"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689185776806"}]},"ts":"1689185776806"} 2023-07-12 18:16:16,811 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=108, ppid=107, state=RUNNABLE; OpenRegionProcedure 6cce2f63d2810edc9a3c8e684b3764c3, server=jenkins-hbase4.apache.org,37689,1689185653014}] 2023-07-12 18:16:16,812 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=106, state=RUNNABLE; OpenRegionProcedure ddf42eebe612bf8fe9e9c04635955f45, server=jenkins-hbase4.apache.org,34493,1689185653159}] 2023-07-12 18:16:16,889 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-12 18:16:16,967 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1689185776582.6cce2f63d2810edc9a3c8e684b3764c3. 2023-07-12 18:16:16,967 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6cce2f63d2810edc9a3c8e684b3764c3, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689185776582.6cce2f63d2810edc9a3c8e684b3764c3.', STARTKEY => '1', ENDKEY => ''} 2023-07-12 18:16:16,968 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1689185776582.ddf42eebe612bf8fe9e9c04635955f45. 2023-07-12 18:16:16,968 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ddf42eebe612bf8fe9e9c04635955f45, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689185776582.ddf42eebe612bf8fe9e9c04635955f45.', STARTKEY => '', ENDKEY => '1'} 2023-07-12 18:16:16,968 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1689185776582.6cce2f63d2810edc9a3c8e684b3764c3. service=AccessControlService 2023-07-12 18:16:16,969 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 18:16:16,969 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1689185776582.ddf42eebe612bf8fe9e9c04635955f45. service=AccessControlService 2023-07-12 18:16:16,969 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 6cce2f63d2810edc9a3c8e684b3764c3 2023-07-12 18:16:16,969 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689185776582.6cce2f63d2810edc9a3c8e684b3764c3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 18:16:16,969 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 18:16:16,969 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 6cce2f63d2810edc9a3c8e684b3764c3 2023-07-12 18:16:16,969 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 6cce2f63d2810edc9a3c8e684b3764c3 2023-07-12 18:16:16,969 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp ddf42eebe612bf8fe9e9c04635955f45 2023-07-12 18:16:16,969 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689185776582.ddf42eebe612bf8fe9e9c04635955f45.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 18:16:16,969 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ddf42eebe612bf8fe9e9c04635955f45 2023-07-12 18:16:16,969 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ddf42eebe612bf8fe9e9c04635955f45 2023-07-12 18:16:16,980 INFO [StoreOpener-6cce2f63d2810edc9a3c8e684b3764c3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 6cce2f63d2810edc9a3c8e684b3764c3 2023-07-12 18:16:16,983 INFO [StoreOpener-ddf42eebe612bf8fe9e9c04635955f45-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region ddf42eebe612bf8fe9e9c04635955f45 2023-07-12 18:16:16,984 DEBUG [StoreOpener-6cce2f63d2810edc9a3c8e684b3764c3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testExportFileSystemStateWithSkipTmp/6cce2f63d2810edc9a3c8e684b3764c3/cf 2023-07-12 18:16:16,984 DEBUG [StoreOpener-6cce2f63d2810edc9a3c8e684b3764c3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testExportFileSystemStateWithSkipTmp/6cce2f63d2810edc9a3c8e684b3764c3/cf 2023-07-12 18:16:16,984 DEBUG [StoreOpener-ddf42eebe612bf8fe9e9c04635955f45-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testExportFileSystemStateWithSkipTmp/ddf42eebe612bf8fe9e9c04635955f45/cf 2023-07-12 18:16:16,984 DEBUG [StoreOpener-ddf42eebe612bf8fe9e9c04635955f45-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testExportFileSystemStateWithSkipTmp/ddf42eebe612bf8fe9e9c04635955f45/cf 2023-07-12 18:16:16,984 INFO [StoreOpener-6cce2f63d2810edc9a3c8e684b3764c3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6cce2f63d2810edc9a3c8e684b3764c3 columnFamilyName cf 2023-07-12 18:16:16,984 INFO [StoreOpener-ddf42eebe612bf8fe9e9c04635955f45-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ddf42eebe612bf8fe9e9c04635955f45 columnFamilyName cf 2023-07-12 18:16:16,986 INFO [StoreOpener-6cce2f63d2810edc9a3c8e684b3764c3-1] regionserver.HStore(310): Store=6cce2f63d2810edc9a3c8e684b3764c3/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 18:16:16,986 INFO [StoreOpener-ddf42eebe612bf8fe9e9c04635955f45-1] regionserver.HStore(310): Store=ddf42eebe612bf8fe9e9c04635955f45/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 18:16:16,987 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testExportFileSystemStateWithSkipTmp/6cce2f63d2810edc9a3c8e684b3764c3 2023-07-12 18:16:16,987 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testExportFileSystemStateWithSkipTmp/ddf42eebe612bf8fe9e9c04635955f45 2023-07-12 18:16:16,987 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testExportFileSystemStateWithSkipTmp/ddf42eebe612bf8fe9e9c04635955f45 2023-07-12 18:16:16,987 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testExportFileSystemStateWithSkipTmp/6cce2f63d2810edc9a3c8e684b3764c3 2023-07-12 18:16:16,990 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ddf42eebe612bf8fe9e9c04635955f45 2023-07-12 18:16:16,990 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 6cce2f63d2810edc9a3c8e684b3764c3 2023-07-12 18:16:16,995 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testExportFileSystemStateWithSkipTmp/6cce2f63d2810edc9a3c8e684b3764c3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 18:16:16,995 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testExportFileSystemStateWithSkipTmp/ddf42eebe612bf8fe9e9c04635955f45/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 18:16:16,996 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ddf42eebe612bf8fe9e9c04635955f45; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59039780, jitterRate=-0.12023872137069702}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 18:16:16,996 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 6cce2f63d2810edc9a3c8e684b3764c3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62825451, jitterRate=-0.06382782757282257}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 18:16:16,996 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ddf42eebe612bf8fe9e9c04635955f45: 2023-07-12 18:16:16,996 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 6cce2f63d2810edc9a3c8e684b3764c3: 2023-07-12 18:16:16,997 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1689185776582.ddf42eebe612bf8fe9e9c04635955f45., pid=109, masterSystemTime=1689185776964 2023-07-12 18:16:16,998 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1689185776582.6cce2f63d2810edc9a3c8e684b3764c3., pid=108, masterSystemTime=1689185776963 2023-07-12 18:16:16,999 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1689185776582.ddf42eebe612bf8fe9e9c04635955f45. 2023-07-12 18:16:16,999 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1689185776582.ddf42eebe612bf8fe9e9c04635955f45. 2023-07-12 18:16:16,999 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=ddf42eebe612bf8fe9e9c04635955f45, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:16:17,000 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1689185776582.6cce2f63d2810edc9a3c8e684b3764c3. 2023-07-12 18:16:17,000 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689185776582.ddf42eebe612bf8fe9e9c04635955f45.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689185776999"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689185776999"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689185776999"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689185776999"}]},"ts":"1689185776999"} 2023-07-12 18:16:17,000 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1689185776582.6cce2f63d2810edc9a3c8e684b3764c3. 2023-07-12 18:16:17,000 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=6cce2f63d2810edc9a3c8e684b3764c3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:16:17,001 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689185776582.6cce2f63d2810edc9a3c8e684b3764c3.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689185777000"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689185777000"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689185777000"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689185777000"}]},"ts":"1689185777000"} 2023-07-12 18:16:17,003 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=106 2023-07-12 18:16:17,003 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=106, state=SUCCESS; OpenRegionProcedure ddf42eebe612bf8fe9e9c04635955f45, server=jenkins-hbase4.apache.org,34493,1689185653159 in 189 msec 2023-07-12 18:16:17,004 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=108, resume processing ppid=107 2023-07-12 18:16:17,004 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=ddf42eebe612bf8fe9e9c04635955f45, ASSIGN in 355 msec 2023-07-12 18:16:17,004 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=107, state=SUCCESS; OpenRegionProcedure 6cce2f63d2810edc9a3c8e684b3764c3, server=jenkins-hbase4.apache.org,37689,1689185653014 in 191 msec 2023-07-12 18:16:17,007 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=107, resume processing ppid=105 2023-07-12 18:16:17,007 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=6cce2f63d2810edc9a3c8e684b3764c3, ASSIGN in 356 msec 2023-07-12 18:16:17,008 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 18:16:17,008 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689185777008"}]},"ts":"1689185777008"} 2023-07-12 18:16:17,009 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-07-12 18:16:17,012 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 18:16:17,012 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-07-12 18:16:17,014 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34493] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-12 18:16:17,016 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 18:16:17,016 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 18:16:17,016 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 18:16:17,016 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 18:16:17,017 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-12 18:16:17,017 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-12 18:16:17,017 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-12 18:16:17,017 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-12 18:16:17,019 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 434 msec 2023-07-12 18:16:17,191 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-12 18:16:17,191 INFO [Listener at jenkins-hbase4.apache.org/41393] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-07-12 18:16:17,193 DEBUG [Listener at jenkins-hbase4.apache.org/41393] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,193 DEBUG [Listener at jenkins-hbase4.apache.org/41393] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1689185776582.ddf42eebe612bf8fe9e9c04635955f45. 2023-07-12 18:16:17,195 INFO [Listener at jenkins-hbase4.apache.org/41393] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 18:16:17,206 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-12 18:16:17,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689185777206 (current time:1689185777206). 2023-07-12 18:16:17,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 18:16:17,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] zookeeper.ReadOnlyZKClient(139): Connect 0x401c9796 to 127.0.0.1:62122 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 18:16:17,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@76b006d7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 18:16:17,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 18:16:17,216 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34876, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 18:16:17,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x401c9796 to 127.0.0.1:62122 2023-07-12 18:16:17,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 18:16:17,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] zookeeper.ReadOnlyZKClient(139): Connect 0x762aca83 to 127.0.0.1:62122 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 18:16:17,222 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@522e53f7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 18:16:17,223 DEBUG [hconnection-0x245e61db-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 18:16:17,226 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34890, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 18:16:17,230 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x762aca83 to 127.0.0.1:62122 2023-07-12 18:16:17,230 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 18:16:17,230 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-12 18:16:17,231 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 18:16:17,231 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-12 18:16:17,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] procedure2.ProcedureExecutor(1029): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-12 18:16:17,234 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-12 18:16:17,235 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689186377234 2023-07-12 18:16:17,235 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-12 18:16:17,235 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,236 DEBUG [Listener at jenkins-hbase4.apache.org/41393] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 18:16:17,236 DEBUG [Listener at jenkins-hbase4.apache.org/41393] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 18:16:17,237 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-12 18:16:17,237 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-12 18:16:17,238 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 5 msec 2023-07-12 18:16:17,238 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-12 18:16:17,239 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689186377239 2023-07-12 18:16:17,248 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,248 INFO [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-12 18:16:17,248 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 18:16:17,249 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-12 18:16:17,249 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-12 18:16:17,249 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,249 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,252 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:16:17,252 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:16:17,252 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:16:17,252 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:16:17,252 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:16:17,252 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:16:17,252 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:16:17,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:16:17,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:16:17,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:16:17,253 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:16:17,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,253 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:16:17,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,253 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,253 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,253 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:16:17,253 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 18:16:17,253 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-12 18:16:17,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-12 18:16:17,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-12 18:16:17,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,254 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-12 18:16:17,254 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-12 18:16:17,254 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-12 18:16:17,254 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,254 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,254 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-12 18:16:17,254 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-12 18:16:17,254 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 18:16:17,254 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 18:16:17,254 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,256 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-12 18:16:17,256 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-12 18:16:17,255 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-12 18:16:17,256 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-12 18:16:17,256 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 18:16:17,256 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-12 18:16:17,257 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34493,1689185653159' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-12 18:16:17,257 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-12 18:16:17,258 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-12 18:16:17,258 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37689,1689185653014' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-12 18:16:17,257 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34205,1689185653087' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-12 18:16:17,262 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,262 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:16:17,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:16:17,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 18:16:17,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 18:16:17,264 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,264 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,264 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,264 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 18:16:17,264 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:16:17,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 18:16:17,264 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,264 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 18:16:17,264 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,264 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 18:16:17,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 18:16:17,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:16:17,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:16:17,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:16:17,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 18:16:17,266 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34493,1689185653159' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-12 18:16:17,266 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@e7b75d7[Count = 1] remaining members to acquire global barrier 2023-07-12 18:16:17,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:16:17,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 18:16:17,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 18:16:17,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 18:16:17,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 18:16:17,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:16:17,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:16:17,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:16:17,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 18:16:17,268 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37689,1689185653014' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-12 18:16:17,268 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@e7b75d7[Count = 0] remaining members to acquire global barrier 2023-07-12 18:16:17,268 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-12 18:16:17,268 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,269 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,269 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,269 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,269 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,269 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,269 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-12 18:16:17,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,269 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,269 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-12 18:16:17,269 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:16:17,270 DEBUG [rs(jenkins-hbase4.apache.org,34493,1689185653159)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689185776582.ddf42eebe612bf8fe9e9c04635955f45. 2023-07-12 18:16:17,269 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 18:16:17,270 DEBUG [rs(jenkins-hbase4.apache.org,34493,1689185653159)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689185776582.ddf42eebe612bf8fe9e9c04635955f45. started... 2023-07-12 18:16:17,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,270 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 18:16:17,270 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-12 18:16:17,270 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-12 18:16:17,270 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,34205,1689185653087' in zk 2023-07-12 18:16:17,270 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:16:17,270 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 18:16:17,270 DEBUG [rs(jenkins-hbase4.apache.org,34493,1689185653159)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ddf42eebe612bf8fe9e9c04635955f45: 2023-07-12 18:16:17,270 DEBUG [rs(jenkins-hbase4.apache.org,34493,1689185653159)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689185776582.ddf42eebe612bf8fe9e9c04635955f45.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,270 DEBUG [rs(jenkins-hbase4.apache.org,34493,1689185653159)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 18:16:17,270 DEBUG [rs(jenkins-hbase4.apache.org,34493,1689185653159)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 18:16:17,270 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 18:16:17,270 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 18:16:17,271 DEBUG [rs(jenkins-hbase4.apache.org,37689,1689185653014)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689185776582.6cce2f63d2810edc9a3c8e684b3764c3. 2023-07-12 18:16:17,271 DEBUG [rs(jenkins-hbase4.apache.org,37689,1689185653014)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689185776582.6cce2f63d2810edc9a3c8e684b3764c3. started... 2023-07-12 18:16:17,272 DEBUG [rs(jenkins-hbase4.apache.org,37689,1689185653014)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6cce2f63d2810edc9a3c8e684b3764c3: 2023-07-12 18:16:17,272 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-12 18:16:17,272 DEBUG [rs(jenkins-hbase4.apache.org,37689,1689185653014)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689185776582.6cce2f63d2810edc9a3c8e684b3764c3.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,272 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 18:16:17,272 DEBUG [rs(jenkins-hbase4.apache.org,37689,1689185653014)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 18:16:17,272 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-12 18:16:17,272 DEBUG [rs(jenkins-hbase4.apache.org,37689,1689185653014)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 18:16:17,289 DEBUG [rs(jenkins-hbase4.apache.org,34493,1689185653159)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689185776582.ddf42eebe612bf8fe9e9c04635955f45. completed. 2023-07-12 18:16:17,289 DEBUG [rs(jenkins-hbase4.apache.org,34493,1689185653159)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689185776582.ddf42eebe612bf8fe9e9c04635955f45. 2023-07-12 18:16:17,289 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 18:16:17,289 DEBUG [rs(jenkins-hbase4.apache.org,37689,1689185653014)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689185776582.6cce2f63d2810edc9a3c8e684b3764c3. completed. 2023-07-12 18:16:17,289 DEBUG [rs(jenkins-hbase4.apache.org,37689,1689185653014)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689185776582.6cce2f63d2810edc9a3c8e684b3764c3. 2023-07-12 18:16:17,289 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 18:16:17,290 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:16:17,290 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-12 18:16:17,290 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,34493,1689185653159' in zk 2023-07-12 18:16:17,290 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 18:16:17,290 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 18:16:17,290 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:16:17,291 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-12 18:16:17,291 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,37689,1689185653014' in zk 2023-07-12 18:16:17,291 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:16:17,291 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-12 18:16:17,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:16:17,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 18:16:17,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 18:16:17,291 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 18:16:17,292 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-12 18:16:17,293 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:16:17,293 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-12 18:16:17,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 18:16:17,293 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 18:16:17,293 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-12 18:16:17,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 18:16:17,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:16:17,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:16:17,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:16:17,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 18:16:17,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:16:17,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:16:17,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:16:17,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,34493,1689185653159': 2023-07-12 18:16:17,298 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34493,1689185653159' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-12 18:16:17,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:16:17,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 18:16:17,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 18:16:17,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 18:16:17,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 18:16:17,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:16:17,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:16:17,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:16:17,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 18:16:17,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:16:17,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:16:17,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:16:17,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,37689,1689185653014': 2023-07-12 18:16:17,302 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37689,1689185653014' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-12 18:16:17,302 INFO [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-12 18:16:17,302 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 18:16:17,302 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 18:16:17,302 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,302 INFO [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 18:16:17,304 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,304 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,304 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,304 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,304 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,304 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:16:17,304 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:16:17,304 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 18:16:17,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 18:16:17,304 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,304 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:16:17,305 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:16:17,305 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:16:17,305 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:16:17,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 18:16:17,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:16:17,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:16:17,305 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:16:17,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:16:17,305 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:16:17,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,305 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:16:17,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 18:16:17,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:16:17,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:16:17,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:16:17,307 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:16:17,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 18:16:17,308 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:16:17,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,308 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:16:17,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:16:17,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:16:17,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:16:17,310 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:16:17,310 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,310 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:16:17,310 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:16:17,310 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:16:17,311 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:16:17,311 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:16:17,311 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:16:17,311 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:16:17,311 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:16:17,311 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:16:17,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:16:17,311 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:16:17,311 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,311 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 18:16:17,311 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,311 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:16:17,311 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:16:17,311 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:16:17,312 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:16:17,313 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:16:17,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:16:17,313 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:16:17,313 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,313 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-12 18:16:17,313 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:16:17,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:16:17,313 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:16:17,313 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:16:17,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:16:17,313 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,313 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,314 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-12 18:16:17,325 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,326 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,336 DEBUG [Listener at jenkins-hbase4.apache.org/41393] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 18:16:17,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-12 18:16:17,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-12 18:16:17,337 DEBUG [Listener at jenkins-hbase4.apache.org/41393] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 18:16:17,351 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,367 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-12 18:16:17,368 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,368 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,368 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689185777235Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1689185777325 (+90 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689185777325Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689185777326 (+1 ms)Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689185777329 (+3 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689185777346 (+17 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689185777367 (+21 ms) 2023-07-12 18:16:17,370 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-12 18:16:17,372 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 135 msec 2023-07-12 18:16:17,537 DEBUG [Listener at jenkins-hbase4.apache.org/41393] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 18:16:17,538 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-12 18:16:17,539 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 18:16:17,542 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34493] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1689185776582.ddf42eebe612bf8fe9e9c04635955f45. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 18:16:17,542 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37689] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1689185776582.6cce2f63d2810edc9a3c8e684b3764c3. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 18:16:17,545 DEBUG [Listener at jenkins-hbase4.apache.org/41393] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,546 DEBUG [Listener at jenkins-hbase4.apache.org/41393] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1689185776582.ddf42eebe612bf8fe9e9c04635955f45. 2023-07-12 18:16:17,546 INFO [Listener at jenkins-hbase4.apache.org/41393] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 18:16:17,557 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-12 18:16:17,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689185777557 (current time:1689185777557). 2023-07-12 18:16:17,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 18:16:17,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] zookeeper.ReadOnlyZKClient(139): Connect 0x322c6b49 to 127.0.0.1:62122 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 18:16:17,576 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@652b846e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 18:16:17,577 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 18:16:17,582 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34892, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 18:16:17,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x322c6b49 to 127.0.0.1:62122 2023-07-12 18:16:17,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 18:16:17,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] zookeeper.ReadOnlyZKClient(139): Connect 0x3070cdf1 to 127.0.0.1:62122 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 18:16:17,600 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@61579e95, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 18:16:17,602 DEBUG [hconnection-0x58666e25-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 18:16:17,603 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34902, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 18:16:17,610 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3070cdf1 to 127.0.0.1:62122 2023-07-12 18:16:17,610 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 18:16:17,610 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-12 18:16:17,611 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 18:16:17,611 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-12 18:16:17,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-12 18:16:17,615 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-12 18:16:17,616 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689186377616 2023-07-12 18:16:17,616 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-12 18:16:17,616 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,619 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-12 18:16:17,623 DEBUG [Listener at jenkins-hbase4.apache.org/41393] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 18:16:17,623 DEBUG [Listener at jenkins-hbase4.apache.org/41393] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 18:16:17,623 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-12 18:16:17,624 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 7 msec 2023-07-12 18:16:17,625 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-12 18:16:17,626 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689186377626 2023-07-12 18:16:17,647 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,647 INFO [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-12 18:16:17,647 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 18:16:17,649 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-12 18:16:17,649 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-12 18:16:17,714 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,714 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,715 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:16:17,715 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:16:17,715 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:16:17,715 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:16:17,715 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:16:17,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:16:17,716 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:16:17,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:16:17,716 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:16:17,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:16:17,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,717 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:16:17,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,717 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,717 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:16:17,717 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,717 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-12 18:16:17,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-12 18:16:17,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,718 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-12 18:16:17,718 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-12 18:16:17,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-12 18:16:17,718 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,718 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:16:17,718 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,718 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-12 18:16:17,718 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-12 18:16:17,718 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 18:16:17,718 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 18:16:17,720 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-12 18:16:17,720 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-12 18:16:17,718 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-12 18:16:17,718 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 18:16:17,720 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34493,1689185653159' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-12 18:16:17,721 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-12 18:16:17,721 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-12 18:16:17,721 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37689,1689185653014' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-12 18:16:17,721 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,721 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-12 18:16:17,721 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 18:16:17,722 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-12 18:16:17,722 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-12 18:16:17,722 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34205,1689185653087' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-12 18:16:17,723 DEBUG [Listener at jenkins-hbase4.apache.org/41393] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 18:16:17,724 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-12 18:16:17,724 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-12 18:16:17,724 DEBUG [Listener at jenkins-hbase4.apache.org/41393] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 18:16:17,728 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:16:17,728 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,728 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:16:17,728 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,728 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:16:17,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 18:16:17,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 18:16:17,729 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,729 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 18:16:17,729 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,729 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 18:16:17,729 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,729 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 18:16:17,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 18:16:17,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 18:16:17,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:16:17,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:16:17,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:16:17,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 18:16:17,731 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37689,1689185653014' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-12 18:16:17,731 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5de0e505[Count = 1] remaining members to acquire global barrier 2023-07-12 18:16:17,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:16:17,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 18:16:17,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 18:16:17,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 18:16:17,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 18:16:17,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:16:17,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:16:17,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:16:17,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 18:16:17,733 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34493,1689185653159' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-12 18:16:17,734 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5de0e505[Count = 0] remaining members to acquire global barrier 2023-07-12 18:16:17,734 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-12 18:16:17,734 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,738 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,738 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,738 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,738 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,738 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,738 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-12 18:16:17,738 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,738 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:16:17,738 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-12 18:16:17,738 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-12 18:16:17,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,738 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 18:16:17,738 DEBUG [rs(jenkins-hbase4.apache.org,34493,1689185653159)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689185776582.ddf42eebe612bf8fe9e9c04635955f45. 2023-07-12 18:16:17,738 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,34205,1689185653087' in zk 2023-07-12 18:16:17,739 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:16:17,739 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 18:16:17,739 DEBUG [rs(jenkins-hbase4.apache.org,34493,1689185653159)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689185776582.ddf42eebe612bf8fe9e9c04635955f45. started... 2023-07-12 18:16:17,739 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 18:16:17,738 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-12 18:16:17,739 INFO [rs(jenkins-hbase4.apache.org,34493,1689185653159)-snapshot-pool-0] regionserver.HRegion(2745): Flushing ddf42eebe612bf8fe9e9c04635955f45 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-12 18:16:17,739 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 18:16:17,739 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 18:16:17,739 DEBUG [rs(jenkins-hbase4.apache.org,37689,1689185653014)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689185776582.6cce2f63d2810edc9a3c8e684b3764c3. 2023-07-12 18:16:17,739 DEBUG [rs(jenkins-hbase4.apache.org,37689,1689185653014)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689185776582.6cce2f63d2810edc9a3c8e684b3764c3. started... 2023-07-12 18:16:17,739 INFO [rs(jenkins-hbase4.apache.org,37689,1689185653014)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 6cce2f63d2810edc9a3c8e684b3764c3 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-12 18:16:17,740 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-12 18:16:17,740 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 18:16:17,740 DEBUG [member: 'jenkins-hbase4.apache.org,34205,1689185653087' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-12 18:16:17,776 INFO [rs(jenkins-hbase4.apache.org,34493,1689185653159)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307125268a35a7b4740b88ba1063f63bb7334 to hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202307125268a35a7b4740b88ba1063f63bb7334 2023-07-12 18:16:17,785 INFO [rs(jenkins-hbase4.apache.org,34493,1689185653159)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testExportFileSystemStateWithSkipTmp/ddf42eebe612bf8fe9e9c04635955f45/.tmp/cf/549040e62840403baf803d8fdac7a9c9 2023-07-12 18:16:17,788 INFO [rs(jenkins-hbase4.apache.org,37689,1689185653014)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230712a29d2c91cc064ce9b4ef7d5698e2822a to hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230712a29d2c91cc064ce9b4ef7d5698e2822a 2023-07-12 18:16:17,794 DEBUG [rs(jenkins-hbase4.apache.org,34493,1689185653159)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testExportFileSystemStateWithSkipTmp/ddf42eebe612bf8fe9e9c04635955f45/.tmp/cf/549040e62840403baf803d8fdac7a9c9 as hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testExportFileSystemStateWithSkipTmp/ddf42eebe612bf8fe9e9c04635955f45/cf/549040e62840403baf803d8fdac7a9c9 2023-07-12 18:16:17,802 INFO [rs(jenkins-hbase4.apache.org,34493,1689185653159)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testExportFileSystemStateWithSkipTmp/ddf42eebe612bf8fe9e9c04635955f45/cf/549040e62840403baf803d8fdac7a9c9, entries=3, sequenceid=6, filesize=5.4 K 2023-07-12 18:16:17,803 INFO [rs(jenkins-hbase4.apache.org,34493,1689185653159)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for ddf42eebe612bf8fe9e9c04635955f45 in 64ms, sequenceid=6, compaction requested=false 2023-07-12 18:16:17,803 DEBUG [rs(jenkins-hbase4.apache.org,34493,1689185653159)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-07-12 18:16:17,804 DEBUG [rs(jenkins-hbase4.apache.org,34493,1689185653159)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ddf42eebe612bf8fe9e9c04635955f45: 2023-07-12 18:16:17,804 DEBUG [rs(jenkins-hbase4.apache.org,34493,1689185653159)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689185776582.ddf42eebe612bf8fe9e9c04635955f45.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,804 DEBUG [rs(jenkins-hbase4.apache.org,34493,1689185653159)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 18:16:17,804 DEBUG [rs(jenkins-hbase4.apache.org,34493,1689185653159)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testExportFileSystemStateWithSkipTmp/ddf42eebe612bf8fe9e9c04635955f45/cf/549040e62840403baf803d8fdac7a9c9] hfiles 2023-07-12 18:16:17,804 DEBUG [rs(jenkins-hbase4.apache.org,34493,1689185653159)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testExportFileSystemStateWithSkipTmp/ddf42eebe612bf8fe9e9c04635955f45/cf/549040e62840403baf803d8fdac7a9c9 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,818 INFO [rs(jenkins-hbase4.apache.org,37689,1689185653014)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testExportFileSystemStateWithSkipTmp/6cce2f63d2810edc9a3c8e684b3764c3/.tmp/cf/27b97f39b3444d36965565fdd54bcc77 2023-07-12 18:16:17,824 DEBUG [rs(jenkins-hbase4.apache.org,37689,1689185653014)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testExportFileSystemStateWithSkipTmp/6cce2f63d2810edc9a3c8e684b3764c3/.tmp/cf/27b97f39b3444d36965565fdd54bcc77 as hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testExportFileSystemStateWithSkipTmp/6cce2f63d2810edc9a3c8e684b3764c3/cf/27b97f39b3444d36965565fdd54bcc77 2023-07-12 18:16:17,829 DEBUG [rs(jenkins-hbase4.apache.org,34493,1689185653159)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689185776582.ddf42eebe612bf8fe9e9c04635955f45. completed. 2023-07-12 18:16:17,829 DEBUG [rs(jenkins-hbase4.apache.org,34493,1689185653159)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689185776582.ddf42eebe612bf8fe9e9c04635955f45. 2023-07-12 18:16:17,829 INFO [rs(jenkins-hbase4.apache.org,37689,1689185653014)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testExportFileSystemStateWithSkipTmp/6cce2f63d2810edc9a3c8e684b3764c3/cf/27b97f39b3444d36965565fdd54bcc77, entries=47, sequenceid=6, filesize=13.4 K 2023-07-12 18:16:17,829 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 18:16:17,829 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 18:16:17,829 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:16:17,829 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-12 18:16:17,829 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,34493,1689185653159' in zk 2023-07-12 18:16:17,830 INFO [rs(jenkins-hbase4.apache.org,37689,1689185653014)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 6cce2f63d2810edc9a3c8e684b3764c3 in 91ms, sequenceid=6, compaction requested=false 2023-07-12 18:16:17,832 DEBUG [rs(jenkins-hbase4.apache.org,37689,1689185653014)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6cce2f63d2810edc9a3c8e684b3764c3: 2023-07-12 18:16:17,832 DEBUG [rs(jenkins-hbase4.apache.org,37689,1689185653014)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689185776582.6cce2f63d2810edc9a3c8e684b3764c3.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,832 DEBUG [rs(jenkins-hbase4.apache.org,37689,1689185653014)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 18:16:17,832 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:16:17,832 DEBUG [rs(jenkins-hbase4.apache.org,37689,1689185653014)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testExportFileSystemStateWithSkipTmp/6cce2f63d2810edc9a3c8e684b3764c3/cf/27b97f39b3444d36965565fdd54bcc77] hfiles 2023-07-12 18:16:17,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:16:17,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 18:16:17,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 18:16:17,832 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-12 18:16:17,832 DEBUG [rs(jenkins-hbase4.apache.org,37689,1689185653014)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testExportFileSystemStateWithSkipTmp/6cce2f63d2810edc9a3c8e684b3764c3/cf/27b97f39b3444d36965565fdd54bcc77 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,832 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 18:16:17,832 DEBUG [member: 'jenkins-hbase4.apache.org,34493,1689185653159' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-12 18:16:17,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 18:16:17,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 18:16:17,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:16:17,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:16:17,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:16:17,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 18:16:17,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:16:17,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:16:17,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,34493,1689185653159': 2023-07-12 18:16:17,845 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34493,1689185653159' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-12 18:16:17,845 DEBUG [rs(jenkins-hbase4.apache.org,37689,1689185653014)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689185776582.6cce2f63d2810edc9a3c8e684b3764c3. completed. 2023-07-12 18:16:17,845 DEBUG [rs(jenkins-hbase4.apache.org,37689,1689185653014)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689185776582.6cce2f63d2810edc9a3c8e684b3764c3. 2023-07-12 18:16:17,845 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 18:16:17,845 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 18:16:17,845 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:16:17,845 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-12 18:16:17,845 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,37689,1689185653014' in zk 2023-07-12 18:16:17,848 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-12 18:16:17,848 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:16:17,848 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 18:16:17,848 DEBUG [member: 'jenkins-hbase4.apache.org,37689,1689185653014' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-12 18:16:17,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:16:17,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 18:16:17,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 18:16:17,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 18:16:17,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 18:16:17,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:16:17,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:16:17,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:16:17,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 18:16:17,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:16:17,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:16:17,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:16:17,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,37689,1689185653014': 2023-07-12 18:16:17,854 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37689,1689185653014' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-12 18:16:17,854 INFO [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-12 18:16:17,854 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 18:16:17,854 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 18:16:17,855 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,855 INFO [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 18:16:17,856 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,856 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,856 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,857 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,857 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:16:17,857 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,857 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 18:16:17,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 18:16:17,857 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:16:17,857 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,857 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:16:17,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,857 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:16:17,858 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:16:17,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:16:17,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 18:16:17,858 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:16:17,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:16:17,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:16:17,858 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:16:17,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,858 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:16:17,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 18:16:17,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,859 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:16:17,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:16:17,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:16:17,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:16:17,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 18:16:17,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,861 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:16:17,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:16:17,862 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:16:17,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:16:17,862 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:16:17,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:16:17,866 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:16:17,866 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:16:17,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:16:17,866 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:16:17,866 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,866 DEBUG [(jenkins-hbase4.apache.org,43177,1689185651541)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 18:16:17,866 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:16:17,866 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,868 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,868 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:16:17,868 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,867 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:16:17,868 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,868 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-12 18:16:17,869 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:16:17,868 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:16:17,868 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:16:17,869 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:16:17,868 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:16:17,869 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:16:17,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:16:17,869 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,869 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:16:17,869 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:16:17,869 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,869 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:16:17,869 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:17,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:16:17,870 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230712a29d2c91cc064ce9b4ef7d5698e2822a, hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202307125268a35a7b4740b88ba1063f63bb7334] mob files 2023-07-12 18:16:17,870 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230712a29d2c91cc064ce9b4ef7d5698e2822a 2023-07-12 18:16:17,870 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202307125268a35a7b4740b88ba1063f63bb7334 2023-07-12 18:16:17,875 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:16:17,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:16:17,875 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:16:17,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:16:17,875 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:16:17,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:16:17,924 DEBUG [Listener at jenkins-hbase4.apache.org/41393] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 18:16:17,926 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-12 18:16:17,926 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-12 18:16:17,926 DEBUG [Listener at jenkins-hbase4.apache.org/41393] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-12 18:16:18,226 DEBUG [Listener at jenkins-hbase4.apache.org/41393] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 18:16:18,228 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-12 18:16:18,228 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-12 18:16:18,228 DEBUG [Listener at jenkins-hbase4.apache.org/41393] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-12 18:16:18,290 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:18,291 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:18,345 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:18,395 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-12 18:16:18,396 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:18,396 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:18,396 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689185777616Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1689185778290 (+674 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689185778290Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1689185778291 (+1 ms)Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1689185778308 (+17 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689185778328 (+20 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689185778395 (+67 ms) 2023-07-12 18:16:18,400 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-12 18:16:18,402 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 782 msec 2023-07-12 18:16:18,728 DEBUG [Listener at jenkins-hbase4.apache.org/41393] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 18:16:18,729 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-12 18:16:18,729 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 18:16:18,730 INFO [Listener at jenkins-hbase4.apache.org/41393] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/export-test/export-1689185778730 2023-07-12 18:16:18,730 INFO [Listener at jenkins-hbase4.apache.org/41393] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:38679, tgtDir=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/export-test/export-1689185778730, rawTgtDir=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/export-test/export-1689185778730, srcFsUri=hdfs://localhost:38679, srcDir=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0 2023-07-12 18:16:18,758 DEBUG [Listener at jenkins-hbase4.apache.org/41393] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:38679, inputRoot=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0 2023-07-12 18:16:18,758 DEBUG [Listener at jenkins-hbase4.apache.org/41393] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-437981706_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/export-test/export-1689185778730, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/export-test/export-1689185778730/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:18,758 INFO [Listener at jenkins-hbase4.apache.org/41393] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:38679, inputRoot=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0, snapshotDir=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-07-12 18:16:18,775 INFO [Listener at jenkins-hbase4.apache.org/41393] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/export-test/export-1689185778730/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:18,815 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-12 18:16:18,816 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-12 18:16:18,817 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-12 18:16:18,817 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-12 18:16:19,879 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/908563f7-ecc5-f8cf-2e08-f8e1a8353ad0/hadoop-2484989190295051361.jar 2023-07-12 18:16:19,880 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-12 18:16:19,880 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-12 18:16:19,968 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/908563f7-ecc5-f8cf-2e08-f8e1a8353ad0/hadoop-8335667815594989261.jar 2023-07-12 18:16:19,969 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-12 18:16:19,969 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-12 18:16:19,970 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-12 18:16:19,971 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-12 18:16:19,971 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-12 18:16:19,972 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-12 18:16:19,972 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-12 18:16:19,973 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-12 18:16:19,974 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-12 18:16:19,974 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-12 18:16:19,975 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-12 18:16:19,975 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-12 18:16:19,976 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-12 18:16:19,976 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-12 18:16:19,977 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-12 18:16:19,978 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-12 18:16:19,979 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 18:16:19,979 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 18:16:19,980 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 18:16:19,980 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 18:16:19,981 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 18:16:19,982 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 18:16:19,982 DEBUG [Listener at jenkins-hbase4.apache.org/41393] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 18:16:20,272 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689185662417_0006_000001 (auth:SIMPLE) 2023-07-12 18:16:21,231 WARN [Listener at jenkins-hbase4.apache.org/41393] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-12 18:16:21,235 INFO [Listener at jenkins-hbase4.apache.org/41393] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-07-12 18:16:21,238 DEBUG [Listener at jenkins-hbase4.apache.org/41393] snapshot.ExportSnapshot(671): export split=0 size=31.5 K 2023-07-12 18:16:21,428 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 18:16:21,429 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 18:16:21,910 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-12 18:16:22,239 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689185662417_0007_000001 (auth:SIMPLE) 2023-07-12 18:16:28,320 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689185662417_0007_000001 (auth:SIMPLE) 2023-07-12 18:16:30,609 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689185662417_0007_000001 (auth:SIMPLE) 2023-07-12 18:16:34,278 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689185662417_0007_000001 (auth:SIMPLE) 2023-07-12 18:16:35,622 INFO [Listener at jenkins-hbase4.apache.org/41393] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-12 18:16:35,622 INFO [Listener at jenkins-hbase4.apache.org/41393] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-12 18:16:35,633 INFO [Listener at jenkins-hbase4.apache.org/41393] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:35,633 INFO [Listener at jenkins-hbase4.apache.org/41393] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-12 18:16:35,633 INFO [Listener at jenkins-hbase4.apache.org/41393] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-12 18:16:35,634 DEBUG [Listener at jenkins-hbase4.apache.org/41393] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-639947816_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:35,634 DEBUG [Listener at jenkins-hbase4.apache.org/41393] snapshot.TestExportSnapshot(367): hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-12 18:16:35,634 DEBUG [Listener at jenkins-hbase4.apache.org/41393] snapshot.TestExportSnapshot(367): hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-12 18:16:35,634 DEBUG [Listener at jenkins-hbase4.apache.org/41393] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-639947816_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/export-test/export-1689185778730/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/export-test/export-1689185778730/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:35,635 DEBUG [Listener at jenkins-hbase4.apache.org/41393] snapshot.TestExportSnapshot(367): hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/export-test/export-1689185778730/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-12 18:16:35,635 DEBUG [Listener at jenkins-hbase4.apache.org/41393] snapshot.TestExportSnapshot(367): hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/export-test/export-1689185778730/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-12 18:16:35,640 INFO [Listener at jenkins-hbase4.apache.org/41393] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:35,641 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:35,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] procedure2.ProcedureExecutor(1029): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:35,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-12 18:16:35,644 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689185795644"}]},"ts":"1689185795644"} 2023-07-12 18:16:35,646 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-07-12 18:16:35,647 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-07-12 18:16:35,648 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=ddf42eebe612bf8fe9e9c04635955f45, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=6cce2f63d2810edc9a3c8e684b3764c3, UNASSIGN}] 2023-07-12 18:16:35,649 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=ddf42eebe612bf8fe9e9c04635955f45, UNASSIGN 2023-07-12 18:16:35,650 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=6cce2f63d2810edc9a3c8e684b3764c3, UNASSIGN 2023-07-12 18:16:35,650 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=ddf42eebe612bf8fe9e9c04635955f45, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:16:35,650 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=6cce2f63d2810edc9a3c8e684b3764c3, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:16:35,650 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689185776582.ddf42eebe612bf8fe9e9c04635955f45.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689185795650"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689185795650"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689185795650"}]},"ts":"1689185795650"} 2023-07-12 18:16:35,650 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689185776582.6cce2f63d2810edc9a3c8e684b3764c3.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689185795650"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689185795650"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689185795650"}]},"ts":"1689185795650"} 2023-07-12 18:16:35,651 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=115, state=RUNNABLE; CloseRegionProcedure ddf42eebe612bf8fe9e9c04635955f45, server=jenkins-hbase4.apache.org,34493,1689185653159}] 2023-07-12 18:16:35,652 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=118, ppid=116, state=RUNNABLE; CloseRegionProcedure 6cce2f63d2810edc9a3c8e684b3764c3, server=jenkins-hbase4.apache.org,37689,1689185653014}] 2023-07-12 18:16:35,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-12 18:16:35,803 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close ddf42eebe612bf8fe9e9c04635955f45 2023-07-12 18:16:35,803 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 6cce2f63d2810edc9a3c8e684b3764c3 2023-07-12 18:16:35,803 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ddf42eebe612bf8fe9e9c04635955f45, disabling compactions & flushes 2023-07-12 18:16:35,803 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 6cce2f63d2810edc9a3c8e684b3764c3, disabling compactions & flushes 2023-07-12 18:16:35,803 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689185776582.ddf42eebe612bf8fe9e9c04635955f45. 2023-07-12 18:16:35,804 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689185776582.6cce2f63d2810edc9a3c8e684b3764c3. 2023-07-12 18:16:35,804 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689185776582.ddf42eebe612bf8fe9e9c04635955f45. 2023-07-12 18:16:35,804 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689185776582.6cce2f63d2810edc9a3c8e684b3764c3. 2023-07-12 18:16:35,804 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689185776582.ddf42eebe612bf8fe9e9c04635955f45. after waiting 0 ms 2023-07-12 18:16:35,804 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689185776582.ddf42eebe612bf8fe9e9c04635955f45. 2023-07-12 18:16:35,804 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689185776582.6cce2f63d2810edc9a3c8e684b3764c3. after waiting 0 ms 2023-07-12 18:16:35,804 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689185776582.6cce2f63d2810edc9a3c8e684b3764c3. 2023-07-12 18:16:35,815 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testExportFileSystemStateWithSkipTmp/ddf42eebe612bf8fe9e9c04635955f45/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 18:16:35,815 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/default/testtb-testExportFileSystemStateWithSkipTmp/6cce2f63d2810edc9a3c8e684b3764c3/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 18:16:35,815 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 18:16:35,815 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 18:16:35,817 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689185776582.ddf42eebe612bf8fe9e9c04635955f45. 2023-07-12 18:16:35,817 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689185776582.6cce2f63d2810edc9a3c8e684b3764c3. 2023-07-12 18:16:35,817 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ddf42eebe612bf8fe9e9c04635955f45: 2023-07-12 18:16:35,817 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 6cce2f63d2810edc9a3c8e684b3764c3: 2023-07-12 18:16:35,819 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 6cce2f63d2810edc9a3c8e684b3764c3 2023-07-12 18:16:35,822 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=6cce2f63d2810edc9a3c8e684b3764c3, regionState=CLOSED 2023-07-12 18:16:35,822 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689185776582.6cce2f63d2810edc9a3c8e684b3764c3.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689185795822"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689185795822"}]},"ts":"1689185795822"} 2023-07-12 18:16:35,822 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed ddf42eebe612bf8fe9e9c04635955f45 2023-07-12 18:16:35,823 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=ddf42eebe612bf8fe9e9c04635955f45, regionState=CLOSED 2023-07-12 18:16:35,823 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689185776582.ddf42eebe612bf8fe9e9c04635955f45.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689185795823"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689185795823"}]},"ts":"1689185795823"} 2023-07-12 18:16:35,827 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=118, resume processing ppid=116 2023-07-12 18:16:35,827 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=116, state=SUCCESS; CloseRegionProcedure 6cce2f63d2810edc9a3c8e684b3764c3, server=jenkins-hbase4.apache.org,37689,1689185653014 in 171 msec 2023-07-12 18:16:35,828 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=6cce2f63d2810edc9a3c8e684b3764c3, UNASSIGN in 179 msec 2023-07-12 18:16:35,828 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=117, resume processing ppid=115 2023-07-12 18:16:35,829 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=115, state=SUCCESS; CloseRegionProcedure ddf42eebe612bf8fe9e9c04635955f45, server=jenkins-hbase4.apache.org,34493,1689185653159 in 175 msec 2023-07-12 18:16:35,830 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=115, resume processing ppid=114 2023-07-12 18:16:35,830 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=ddf42eebe612bf8fe9e9c04635955f45, UNASSIGN in 180 msec 2023-07-12 18:16:35,831 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689185795831"}]},"ts":"1689185795831"} 2023-07-12 18:16:35,832 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-07-12 18:16:35,835 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-07-12 18:16:35,836 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 194 msec 2023-07-12 18:16:35,946 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-12 18:16:35,947 INFO [Listener at jenkins-hbase4.apache.org/41393] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-07-12 18:16:35,947 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:35,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] procedure2.ProcedureExecutor(1029): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:35,950 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:35,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:35,951 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:35,952 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34493] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:35,956 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ddf42eebe612bf8fe9e9c04635955f45 2023-07-12 18:16:35,956 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:35,956 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:35,956 DEBUG [HFileArchiver-23] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6cce2f63d2810edc9a3c8e684b3764c3 2023-07-12 18:16:35,956 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:35,956 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:35,957 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-12 18:16:35,957 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-12 18:16:35,957 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-12 18:16:35,957 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-12 18:16:35,958 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:35,958 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 18:16:35,958 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:35,958 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:35,958 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 18:16:35,958 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 18:16:35,958 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:35,958 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 18:16:35,959 DEBUG [HFileArchiver-22] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ddf42eebe612bf8fe9e9c04635955f45/cf, FileablePath, hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ddf42eebe612bf8fe9e9c04635955f45/recovered.edits] 2023-07-12 18:16:35,959 DEBUG [HFileArchiver-23] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6cce2f63d2810edc9a3c8e684b3764c3/cf, FileablePath, hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6cce2f63d2810edc9a3c8e684b3764c3/recovered.edits] 2023-07-12 18:16:35,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-12 18:16:35,963 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ddf42eebe612bf8fe9e9c04635955f45/cf/549040e62840403baf803d8fdac7a9c9 to hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/ddf42eebe612bf8fe9e9c04635955f45/cf/549040e62840403baf803d8fdac7a9c9 2023-07-12 18:16:35,963 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6cce2f63d2810edc9a3c8e684b3764c3/cf/27b97f39b3444d36965565fdd54bcc77 to hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/6cce2f63d2810edc9a3c8e684b3764c3/cf/27b97f39b3444d36965565fdd54bcc77 2023-07-12 18:16:35,966 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ddf42eebe612bf8fe9e9c04635955f45/recovered.edits/9.seqid to hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/ddf42eebe612bf8fe9e9c04635955f45/recovered.edits/9.seqid 2023-07-12 18:16:35,966 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6cce2f63d2810edc9a3c8e684b3764c3/recovered.edits/9.seqid to hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/6cce2f63d2810edc9a3c8e684b3764c3/recovered.edits/9.seqid 2023-07-12 18:16:35,966 DEBUG [HFileArchiver-22] backup.HFileArchiver(596): Deleted hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ddf42eebe612bf8fe9e9c04635955f45 2023-07-12 18:16:35,966 DEBUG [HFileArchiver-23] backup.HFileArchiver(596): Deleted hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6cce2f63d2810edc9a3c8e684b3764c3 2023-07-12 18:16:35,966 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-12 18:16:35,967 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-07-12 18:16:35,967 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf] 2023-07-12 18:16:35,971 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230712a29d2c91cc064ce9b4ef7d5698e2822a to hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230712a29d2c91cc064ce9b4ef7d5698e2822a 2023-07-12 18:16:35,972 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202307125268a35a7b4740b88ba1063f63bb7334 to hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202307125268a35a7b4740b88ba1063f63bb7334 2023-07-12 18:16:35,973 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-07-12 18:16:35,976 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:35,978 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-07-12 18:16:35,980 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-07-12 18:16:35,981 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:35,981 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-07-12 18:16:35,982 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689185776582.ddf42eebe612bf8fe9e9c04635955f45.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689185795982"}]},"ts":"9223372036854775807"} 2023-07-12 18:16:35,982 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689185776582.6cce2f63d2810edc9a3c8e684b3764c3.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689185795982"}]},"ts":"9223372036854775807"} 2023-07-12 18:16:35,983 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-12 18:16:35,983 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => ddf42eebe612bf8fe9e9c04635955f45, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689185776582.ddf42eebe612bf8fe9e9c04635955f45.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 6cce2f63d2810edc9a3c8e684b3764c3, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689185776582.6cce2f63d2810edc9a3c8e684b3764c3.', STARTKEY => '1', ENDKEY => ''}] 2023-07-12 18:16:35,983 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-07-12 18:16:35,984 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689185795983"}]},"ts":"9223372036854775807"} 2023-07-12 18:16:35,985 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-07-12 18:16:35,987 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:35,988 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 40 msec 2023-07-12 18:16:36,060 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-12 18:16:36,061 INFO [Listener at jenkins-hbase4.apache.org/41393] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-07-12 18:16:36,067 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-12 18:16:36,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:36,073 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-12 18:16:36,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43177] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:36,103 INFO [Listener at jenkins-hbase4.apache.org/41393] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=761 (was 763), OpenFileDescriptor=897 (was 916), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=654 (was 657), ProcessCount=177 (was 179), AvailableMemoryMB=3216 (was 3571) 2023-07-12 18:16:36,103 WARN [Listener at jenkins-hbase4.apache.org/41393] hbase.ResourceChecker(130): Thread=761 is superior to 500 2023-07-12 18:16:36,103 INFO [Listener at jenkins-hbase4.apache.org/41393] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-07-12 18:16:36,128 INFO [Listener at jenkins-hbase4.apache.org/41393] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-12 18:16:40,483 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689185662417_0007_000001 (auth:SIMPLE) 2023-07-12 18:16:41,395 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-12 18:16:50,273 INFO [Listener at jenkins-hbase4.apache.org/41393] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-12 18:17:04,304 ERROR [Thread[Thread-409,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-12 18:17:04,305 INFO [Listener at jenkins-hbase4.apache.org/41393] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-12 18:17:04,416 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-07-12 18:17:04,429 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-07-12 18:17:04,430 ERROR [Thread[Thread-419,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-12 18:17:04,456 INFO [Listener at jenkins-hbase4.apache.org/41393] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-12 18:17:04,561 ERROR [Thread[Thread-383,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-12 18:17:04,561 INFO [Listener at jenkins-hbase4.apache.org/41393] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-07-12 18:17:04,561 INFO [Listener at jenkins-hbase4.apache.org/41393] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-12 18:17:04,561 INFO [Listener at jenkins-hbase4.apache.org/41393] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-12 18:17:04,561 DEBUG [Listener at jenkins-hbase4.apache.org/41393] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x79a32b3f to 127.0.0.1:62122 2023-07-12 18:17:04,562 DEBUG [Listener at jenkins-hbase4.apache.org/41393] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 18:17:04,562 DEBUG [Listener at jenkins-hbase4.apache.org/41393] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-12 18:17:04,562 DEBUG [Listener at jenkins-hbase4.apache.org/41393] util.JVMClusterUtil(257): Found active master hash=148349516, stopped=false 2023-07-12 18:17:04,563 DEBUG [Listener at jenkins-hbase4.apache.org/41393] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 18:17:04,563 DEBUG [Listener at jenkins-hbase4.apache.org/41393] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-12 18:17:04,563 INFO [Listener at jenkins-hbase4.apache.org/41393] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,43177,1689185651541 2023-07-12 18:17:04,564 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-12 18:17:04,564 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-12 18:17:04,564 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 18:17:04,564 INFO [Listener at jenkins-hbase4.apache.org/41393] procedure2.ProcedureExecutor(629): Stopping 2023-07-12 18:17:04,564 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-12 18:17:04,565 DEBUG [Listener at jenkins-hbase4.apache.org/41393] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x40bdf078 to 127.0.0.1:62122 2023-07-12 18:17:04,565 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 18:17:04,564 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-12 18:17:04,565 DEBUG [Listener at jenkins-hbase4.apache.org/41393] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 18:17:04,565 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 18:17:04,565 INFO [Listener at jenkins-hbase4.apache.org/41393] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,37689,1689185653014' ***** 2023-07-12 18:17:04,565 DEBUG [Listener at jenkins-hbase4.apache.org/41393] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 18:17:04,566 INFO [Listener at jenkins-hbase4.apache.org/41393] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-12 18:17:04,566 INFO [RS:0;jenkins-hbase4:37689] regionserver.HeapMemoryManager(220): Stopping 2023-07-12 18:17:04,566 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 18:17:04,566 INFO [RS:0;jenkins-hbase4:37689] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-12 18:17:04,566 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 18:17:04,566 INFO [RS:0;jenkins-hbase4:37689] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-12 18:17:04,566 INFO [Listener at jenkins-hbase4.apache.org/41393] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,34205,1689185653087' ***** 2023-07-12 18:17:04,566 INFO [RS:0;jenkins-hbase4:37689] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:17:04,566 DEBUG [Listener at jenkins-hbase4.apache.org/41393] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 18:17:04,566 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-12 18:17:04,567 INFO [Listener at jenkins-hbase4.apache.org/41393] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-12 18:17:04,566 DEBUG [RS:0;jenkins-hbase4:37689] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7b8bcf25 to 127.0.0.1:62122 2023-07-12 18:17:04,567 INFO [Listener at jenkins-hbase4.apache.org/41393] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,34493,1689185653159' ***** 2023-07-12 18:17:04,567 INFO [RS:1;jenkins-hbase4:34205] regionserver.HeapMemoryManager(220): Stopping 2023-07-12 18:17:04,567 DEBUG [RS:0;jenkins-hbase4:37689] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 18:17:04,567 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-12 18:17:04,567 INFO [RS:1;jenkins-hbase4:34205] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-12 18:17:04,568 INFO [RS:0;jenkins-hbase4:37689] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,37689,1689185653014; all regions closed. 2023-07-12 18:17:04,567 DEBUG [Listener at jenkins-hbase4.apache.org/41393] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 18:17:04,568 INFO [RS:1;jenkins-hbase4:34205] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-12 18:17:04,569 INFO [Listener at jenkins-hbase4.apache.org/41393] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-12 18:17:04,569 INFO [RS:1;jenkins-hbase4:34205] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:17:04,569 DEBUG [RS:1;jenkins-hbase4:34205] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3d682cdc to 127.0.0.1:62122 2023-07-12 18:17:04,569 DEBUG [RS:1;jenkins-hbase4:34205] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 18:17:04,569 INFO [RS:2;jenkins-hbase4:34493] regionserver.HeapMemoryManager(220): Stopping 2023-07-12 18:17:04,569 INFO [RS:2;jenkins-hbase4:34493] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-12 18:17:04,571 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-12 18:17:04,571 INFO [RS:1;jenkins-hbase4:34205] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,34205,1689185653087; all regions closed. 2023-07-12 18:17:04,571 INFO [RS:2;jenkins-hbase4:34493] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-12 18:17:04,571 INFO [RS:2;jenkins-hbase4:34493] regionserver.HRegionServer(3305): Received CLOSE for c9d13a2e32b182765840f6e1f06b1b0f 2023-07-12 18:17:04,572 INFO [RS:2;jenkins-hbase4:34493] regionserver.HRegionServer(3305): Received CLOSE for f85a69b35af74d348ccb66c05819106e 2023-07-12 18:17:04,572 INFO [RS:2;jenkins-hbase4:34493] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:17:04,572 DEBUG [RS:2;jenkins-hbase4:34493] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1a349d55 to 127.0.0.1:62122 2023-07-12 18:17:04,572 DEBUG [RS:2;jenkins-hbase4:34493] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 18:17:04,572 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c9d13a2e32b182765840f6e1f06b1b0f, disabling compactions & flushes 2023-07-12 18:17:04,572 INFO [RS:2;jenkins-hbase4:34493] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-12 18:17:04,572 INFO [RS:2;jenkins-hbase4:34493] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-12 18:17:04,572 INFO [RS:2;jenkins-hbase4:34493] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-12 18:17:04,572 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689185656195.c9d13a2e32b182765840f6e1f06b1b0f. 2023-07-12 18:17:04,573 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689185656195.c9d13a2e32b182765840f6e1f06b1b0f. 2023-07-12 18:17:04,573 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689185656195.c9d13a2e32b182765840f6e1f06b1b0f. after waiting 0 ms 2023-07-12 18:17:04,573 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689185656195.c9d13a2e32b182765840f6e1f06b1b0f. 2023-07-12 18:17:04,573 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing c9d13a2e32b182765840f6e1f06b1b0f 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-12 18:17:04,573 INFO [RS:2;jenkins-hbase4:34493] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-12 18:17:04,574 INFO [RS:2;jenkins-hbase4:34493] regionserver.HRegionServer(1474): Waiting on 3 regions to close 2023-07-12 18:17:04,574 DEBUG [RS:2;jenkins-hbase4:34493] regionserver.HRegionServer(1478): Online Regions={c9d13a2e32b182765840f6e1f06b1b0f=hbase:namespace,,1689185656195.c9d13a2e32b182765840f6e1f06b1b0f., f85a69b35af74d348ccb66c05819106e=hbase:acl,,1689185657046.f85a69b35af74d348ccb66c05819106e., 1588230740=hbase:meta,,1.1588230740} 2023-07-12 18:17:04,575 DEBUG [RS:2;jenkins-hbase4:34493] regionserver.HRegionServer(1504): Waiting on 1588230740, c9d13a2e32b182765840f6e1f06b1b0f, f85a69b35af74d348ccb66c05819106e 2023-07-12 18:17:04,579 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-12 18:17:04,579 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-12 18:17:04,579 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-12 18:17:04,579 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-12 18:17:04,579 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-12 18:17:04,579 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-07-12 18:17:04,583 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-12 18:17:04,583 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-12 18:17:04,591 DEBUG [RS:1;jenkins-hbase4:34205] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/oldWALs 2023-07-12 18:17:04,591 INFO [RS:1;jenkins-hbase4:34205] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C34205%2C1689185653087:(num 1689185655376) 2023-07-12 18:17:04,591 DEBUG [RS:1;jenkins-hbase4:34205] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 18:17:04,591 INFO [RS:1;jenkins-hbase4:34205] regionserver.LeaseManager(133): Closed leases 2023-07-12 18:17:04,599 DEBUG [RS:0;jenkins-hbase4:37689] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/oldWALs 2023-07-12 18:17:04,599 INFO [RS:0;jenkins-hbase4:37689] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C37689%2C1689185653014:(num 1689185655385) 2023-07-12 18:17:04,599 INFO [RS:1;jenkins-hbase4:34205] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-12 18:17:04,599 DEBUG [RS:0;jenkins-hbase4:37689] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 18:17:04,600 INFO [RS:0;jenkins-hbase4:37689] regionserver.LeaseManager(133): Closed leases 2023-07-12 18:17:04,600 INFO [RS:1;jenkins-hbase4:34205] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-12 18:17:04,600 INFO [RS:1;jenkins-hbase4:34205] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-12 18:17:04,600 INFO [RS:1;jenkins-hbase4:34205] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-12 18:17:04,600 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-12 18:17:04,600 INFO [RS:0;jenkins-hbase4:37689] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-12 18:17:04,601 INFO [RS:0;jenkins-hbase4:37689] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-12 18:17:04,601 INFO [RS:0;jenkins-hbase4:37689] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-12 18:17:04,601 INFO [RS:0;jenkins-hbase4:37689] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-12 18:17:04,601 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-12 18:17:04,602 INFO [RS:1;jenkins-hbase4:34205] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:34205 2023-07-12 18:17:04,603 INFO [RS:0;jenkins-hbase4:37689] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:37689 2023-07-12 18:17:04,607 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-12 18:17:04,612 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:17:04,612 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:17:04,612 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-12 18:17:04,612 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-12 18:17:04,612 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-12 18:17:04,612 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,37689,1689185653014 2023-07-12 18:17:04,612 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-12 18:17:04,613 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:17:04,613 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:17:04,613 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34205,1689185653087 2023-07-12 18:17:04,614 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,34205,1689185653087] 2023-07-12 18:17:04,615 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,34205,1689185653087; numProcessing=1 2023-07-12 18:17:04,617 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/hbase/meta/1588230740/.tmp/info/ec45eb5742bd420cb9796067b80c963b 2023-07-12 18:17:04,617 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/hbase/namespace/c9d13a2e32b182765840f6e1f06b1b0f/.tmp/info/eebe680dde0d44da98db06120f20ea29 2023-07-12 18:17:04,617 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,34205,1689185653087 already deleted, retry=false 2023-07-12 18:17:04,617 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,34205,1689185653087 expired; onlineServers=2 2023-07-12 18:17:04,617 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,37689,1689185653014] 2023-07-12 18:17:04,617 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,37689,1689185653014; numProcessing=2 2023-07-12 18:17:04,622 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ec45eb5742bd420cb9796067b80c963b 2023-07-12 18:17:04,622 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/hbase/namespace/c9d13a2e32b182765840f6e1f06b1b0f/.tmp/info/eebe680dde0d44da98db06120f20ea29 as hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/hbase/namespace/c9d13a2e32b182765840f6e1f06b1b0f/info/eebe680dde0d44da98db06120f20ea29 2023-07-12 18:17:04,633 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/hbase/namespace/c9d13a2e32b182765840f6e1f06b1b0f/info/eebe680dde0d44da98db06120f20ea29, entries=2, sequenceid=6, filesize=4.8 K 2023-07-12 18:17:04,634 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for c9d13a2e32b182765840f6e1f06b1b0f in 61ms, sequenceid=6, compaction requested=false 2023-07-12 18:17:04,645 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/hbase/meta/1588230740/.tmp/rep_barrier/f330bfab97294d22bfbdb272d1f059ed 2023-07-12 18:17:04,645 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/hbase/namespace/c9d13a2e32b182765840f6e1f06b1b0f/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 18:17:04,646 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 18:17:04,647 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689185656195.c9d13a2e32b182765840f6e1f06b1b0f. 2023-07-12 18:17:04,647 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c9d13a2e32b182765840f6e1f06b1b0f: 2023-07-12 18:17:04,647 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1689185656195.c9d13a2e32b182765840f6e1f06b1b0f. 2023-07-12 18:17:04,647 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f85a69b35af74d348ccb66c05819106e, disabling compactions & flushes 2023-07-12 18:17:04,648 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689185657046.f85a69b35af74d348ccb66c05819106e. 2023-07-12 18:17:04,648 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689185657046.f85a69b35af74d348ccb66c05819106e. 2023-07-12 18:17:04,648 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689185657046.f85a69b35af74d348ccb66c05819106e. after waiting 0 ms 2023-07-12 18:17:04,648 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689185657046.f85a69b35af74d348ccb66c05819106e. 2023-07-12 18:17:04,648 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing f85a69b35af74d348ccb66c05819106e 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-07-12 18:17:04,651 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f330bfab97294d22bfbdb272d1f059ed 2023-07-12 18:17:04,672 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/hbase/acl/f85a69b35af74d348ccb66c05819106e/.tmp/l/356a6326ee474d488c95039acdce3fd0 2023-07-12 18:17:04,676 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/hbase/meta/1588230740/.tmp/table/66c4288ce1f94c94beddb007ea2cc3c1 2023-07-12 18:17:04,678 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 356a6326ee474d488c95039acdce3fd0 2023-07-12 18:17:04,678 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/hbase/acl/f85a69b35af74d348ccb66c05819106e/.tmp/l/356a6326ee474d488c95039acdce3fd0 as hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/hbase/acl/f85a69b35af74d348ccb66c05819106e/l/356a6326ee474d488c95039acdce3fd0 2023-07-12 18:17:04,680 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 66c4288ce1f94c94beddb007ea2cc3c1 2023-07-12 18:17:04,680 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/hbase/meta/1588230740/.tmp/info/ec45eb5742bd420cb9796067b80c963b as hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/hbase/meta/1588230740/info/ec45eb5742bd420cb9796067b80c963b 2023-07-12 18:17:04,685 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 356a6326ee474d488c95039acdce3fd0 2023-07-12 18:17:04,685 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/hbase/acl/f85a69b35af74d348ccb66c05819106e/l/356a6326ee474d488c95039acdce3fd0, entries=7, sequenceid=18, filesize=5.2 K 2023-07-12 18:17:04,686 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ec45eb5742bd420cb9796067b80c963b 2023-07-12 18:17:04,687 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for f85a69b35af74d348ccb66c05819106e in 38ms, sequenceid=18, compaction requested=false 2023-07-12 18:17:04,687 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/hbase/meta/1588230740/info/ec45eb5742bd420cb9796067b80c963b, entries=48, sequenceid=131, filesize=10.3 K 2023-07-12 18:17:04,688 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/hbase/meta/1588230740/.tmp/rep_barrier/f330bfab97294d22bfbdb272d1f059ed as hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/hbase/meta/1588230740/rep_barrier/f330bfab97294d22bfbdb272d1f059ed 2023-07-12 18:17:04,693 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f330bfab97294d22bfbdb272d1f059ed 2023-07-12 18:17:04,693 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/hbase/meta/1588230740/rep_barrier/f330bfab97294d22bfbdb272d1f059ed, entries=13, sequenceid=131, filesize=6.4 K 2023-07-12 18:17:04,694 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/hbase/meta/1588230740/.tmp/table/66c4288ce1f94c94beddb007ea2cc3c1 as hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/hbase/meta/1588230740/table/66c4288ce1f94c94beddb007ea2cc3c1 2023-07-12 18:17:04,698 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 66c4288ce1f94c94beddb007ea2cc3c1 2023-07-12 18:17:04,700 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/hbase/meta/1588230740/table/66c4288ce1f94c94beddb007ea2cc3c1, entries=24, sequenceid=131, filesize=6.9 K 2023-07-12 18:17:04,701 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 122ms, sequenceid=131, compaction requested=false 2023-07-12 18:17:04,715 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 18:17:04,715 INFO [RS:0;jenkins-hbase4:37689] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,37689,1689185653014; zookeeper connection closed. 2023-07-12 18:17:04,717 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 18:17:04,718 INFO [RS:1;jenkins-hbase4:34205] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,34205,1689185653087; zookeeper connection closed. 2023-07-12 18:17:04,715 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:37689-0x1015abe0a7e0001, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 18:17:04,718 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34205-0x1015abe0a7e0002, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 18:17:04,718 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@4c228e56] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@4c228e56 2023-07-12 18:17:04,718 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/hbase/acl/f85a69b35af74d348ccb66c05819106e/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-07-12 18:17:04,718 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@721e187a] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@721e187a 2023-07-12 18:17:04,719 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 18:17:04,719 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1689185657046.f85a69b35af74d348ccb66c05819106e. 2023-07-12 18:17:04,719 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f85a69b35af74d348ccb66c05819106e: 2023-07-12 18:17:04,719 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,37689,1689185653014 already deleted, retry=false 2023-07-12 18:17:04,719 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,37689,1689185653014 expired; onlineServers=1 2023-07-12 18:17:04,719 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1689185657046.f85a69b35af74d348ccb66c05819106e. 2023-07-12 18:17:04,722 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-07-12 18:17:04,722 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 18:17:04,722 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-12 18:17:04,723 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-12 18:17:04,723 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-12 18:17:04,723 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-12 18:17:04,775 INFO [RS:2;jenkins-hbase4:34493] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,34493,1689185653159; all regions closed. 2023-07-12 18:17:04,797 DEBUG [RS:2;jenkins-hbase4:34493] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/oldWALs 2023-07-12 18:17:04,797 INFO [RS:2;jenkins-hbase4:34493] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C34493%2C1689185653159.meta:.meta(num 1689185655817) 2023-07-12 18:17:04,808 DEBUG [RS:2;jenkins-hbase4:34493] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/oldWALs 2023-07-12 18:17:04,808 INFO [RS:2;jenkins-hbase4:34493] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C34493%2C1689185653159:(num 1689185655377) 2023-07-12 18:17:04,808 DEBUG [RS:2;jenkins-hbase4:34493] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 18:17:04,809 INFO [RS:2;jenkins-hbase4:34493] regionserver.LeaseManager(133): Closed leases 2023-07-12 18:17:04,809 INFO [RS:2;jenkins-hbase4:34493] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-12 18:17:04,809 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-12 18:17:04,810 INFO [RS:2;jenkins-hbase4:34493] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:34493 2023-07-12 18:17:04,811 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34493,1689185653159 2023-07-12 18:17:04,811 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-12 18:17:04,814 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,34493,1689185653159] 2023-07-12 18:17:04,814 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,34493,1689185653159; numProcessing=3 2023-07-12 18:17:04,818 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,34493,1689185653159 already deleted, retry=false 2023-07-12 18:17:04,819 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,34493,1689185653159 expired; onlineServers=0 2023-07-12 18:17:04,819 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,43177,1689185651541' ***** 2023-07-12 18:17:04,819 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-12 18:17:04,819 DEBUG [M:0;jenkins-hbase4:43177] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@49eaa877, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-12 18:17:04,819 INFO [M:0;jenkins-hbase4:43177] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,43177,1689185651541 2023-07-12 18:17:04,819 INFO [M:0;jenkins-hbase4:43177] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,43177,1689185651541; all regions closed. 2023-07-12 18:17:04,819 DEBUG [M:0;jenkins-hbase4:43177] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 18:17:04,819 DEBUG [M:0;jenkins-hbase4:43177] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-12 18:17:04,819 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-12 18:17:04,819 DEBUG [M:0;jenkins-hbase4:43177] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-12 18:17:04,819 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689185654814] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689185654814,5,FailOnTimeoutGroup] 2023-07-12 18:17:04,819 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689185654815] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689185654815,5,FailOnTimeoutGroup] 2023-07-12 18:17:04,820 INFO [M:0;jenkins-hbase4:43177] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-12 18:17:04,820 INFO [M:0;jenkins-hbase4:43177] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-12 18:17:04,820 INFO [M:0;jenkins-hbase4:43177] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-07-12 18:17:04,820 DEBUG [M:0;jenkins-hbase4:43177] master.HMaster(1512): Stopping service threads 2023-07-12 18:17:04,820 INFO [M:0;jenkins-hbase4:43177] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-12 18:17:04,820 ERROR [M:0;jenkins-hbase4:43177] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-22,5,PEWorkerGroup] Thread[HFileArchiver-23,5,PEWorkerGroup] 2023-07-12 18:17:04,820 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-12 18:17:04,821 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 18:17:04,821 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-12 18:17:04,821 INFO [M:0;jenkins-hbase4:43177] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-12 18:17:04,821 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-12 18:17:04,822 DEBUG [M:0;jenkins-hbase4:43177] zookeeper.ZKUtil(398): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-12 18:17:04,822 WARN [M:0;jenkins-hbase4:43177] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-12 18:17:04,822 INFO [M:0;jenkins-hbase4:43177] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-12 18:17:04,823 INFO [M:0;jenkins-hbase4:43177] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-12 18:17:04,824 DEBUG [M:0;jenkins-hbase4:43177] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-12 18:17:04,824 INFO [M:0;jenkins-hbase4:43177] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 18:17:04,824 DEBUG [M:0;jenkins-hbase4:43177] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 18:17:04,824 DEBUG [M:0;jenkins-hbase4:43177] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-12 18:17:04,824 DEBUG [M:0;jenkins-hbase4:43177] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 18:17:04,824 INFO [M:0;jenkins-hbase4:43177] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=375.65 KB heapSize=451.99 KB 2023-07-12 18:17:04,866 INFO [M:0;jenkins-hbase4:43177] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=375.65 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/b0ade3b12fed4349a4d457d417c7c310 2023-07-12 18:17:04,870 INFO [M:0;jenkins-hbase4:43177] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b0ade3b12fed4349a4d457d417c7c310 2023-07-12 18:17:04,879 DEBUG [M:0;jenkins-hbase4:43177] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/b0ade3b12fed4349a4d457d417c7c310 as hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/b0ade3b12fed4349a4d457d417c7c310 2023-07-12 18:17:04,885 INFO [M:0;jenkins-hbase4:43177] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b0ade3b12fed4349a4d457d417c7c310 2023-07-12 18:17:04,885 INFO [M:0;jenkins-hbase4:43177] regionserver.HStore(1080): Added hdfs://localhost:38679/user/jenkins/test-data/4c8c027d-c49a-cdbe-ab11-f89757c339e0/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/b0ade3b12fed4349a4d457d417c7c310, entries=119, sequenceid=899, filesize=28.6 K 2023-07-12 18:17:04,886 INFO [M:0;jenkins-hbase4:43177] regionserver.HRegion(2948): Finished flush of dataSize ~375.65 KB/384663, heapSize ~451.98 KB/462824, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 62ms, sequenceid=899, compaction requested=false 2023-07-12 18:17:04,894 INFO [M:0;jenkins-hbase4:43177] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 18:17:04,894 DEBUG [M:0;jenkins-hbase4:43177] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-12 18:17:04,900 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-12 18:17:04,900 INFO [M:0;jenkins-hbase4:43177] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-12 18:17:04,900 INFO [M:0;jenkins-hbase4:43177] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:43177 2023-07-12 18:17:04,903 DEBUG [M:0;jenkins-hbase4:43177] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,43177,1689185651541 already deleted, retry=false 2023-07-12 18:17:04,915 INFO [RS:2;jenkins-hbase4:34493] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,34493,1689185653159; zookeeper connection closed. 2023-07-12 18:17:04,915 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 18:17:04,915 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): regionserver:34493-0x1015abe0a7e0003, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 18:17:04,915 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@6013d726] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@6013d726 2023-07-12 18:17:04,915 INFO [Listener at jenkins-hbase4.apache.org/41393] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-07-12 18:17:05,015 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 18:17:05,015 INFO [M:0;jenkins-hbase4:43177] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,43177,1689185651541; zookeeper connection closed. 2023-07-12 18:17:05,015 DEBUG [Listener at localhost/42431-EventThread] zookeeper.ZKWatcher(600): master:43177-0x1015abe0a7e0000, quorum=127.0.0.1:62122, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 18:17:05,017 WARN [Listener at jenkins-hbase4.apache.org/41393] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-12 18:17:05,021 INFO [Listener at jenkins-hbase4.apache.org/41393] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-12 18:17:05,125 WARN [BP-574222949-172.31.14.131-1689185647155 heartbeating to localhost/127.0.0.1:38679] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-12 18:17:05,125 WARN [BP-574222949-172.31.14.131-1689185647155 heartbeating to localhost/127.0.0.1:38679] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-574222949-172.31.14.131-1689185647155 (Datanode Uuid d5e16857-bda8-439e-a46a-adafb152d542) service to localhost/127.0.0.1:38679 2023-07-12 18:17:05,127 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/908563f7-ecc5-f8cf-2e08-f8e1a8353ad0/cluster_816eff0a-2a97-4927-37b9-33079a1e6298/dfs/data/data5/current/BP-574222949-172.31.14.131-1689185647155] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-12 18:17:05,127 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/908563f7-ecc5-f8cf-2e08-f8e1a8353ad0/cluster_816eff0a-2a97-4927-37b9-33079a1e6298/dfs/data/data6/current/BP-574222949-172.31.14.131-1689185647155] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-12 18:17:05,129 WARN [Listener at jenkins-hbase4.apache.org/41393] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-12 18:17:05,132 INFO [Listener at jenkins-hbase4.apache.org/41393] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-12 18:17:05,236 WARN [BP-574222949-172.31.14.131-1689185647155 heartbeating to localhost/127.0.0.1:38679] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-12 18:17:05,236 WARN [BP-574222949-172.31.14.131-1689185647155 heartbeating to localhost/127.0.0.1:38679] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-574222949-172.31.14.131-1689185647155 (Datanode Uuid 93a91c2e-dad5-4070-a9dd-d35693afaee2) service to localhost/127.0.0.1:38679 2023-07-12 18:17:05,237 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/908563f7-ecc5-f8cf-2e08-f8e1a8353ad0/cluster_816eff0a-2a97-4927-37b9-33079a1e6298/dfs/data/data3/current/BP-574222949-172.31.14.131-1689185647155] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-12 18:17:05,237 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/908563f7-ecc5-f8cf-2e08-f8e1a8353ad0/cluster_816eff0a-2a97-4927-37b9-33079a1e6298/dfs/data/data4/current/BP-574222949-172.31.14.131-1689185647155] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-12 18:17:05,238 WARN [Listener at jenkins-hbase4.apache.org/41393] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-12 18:17:05,246 INFO [Listener at jenkins-hbase4.apache.org/41393] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-12 18:17:05,350 WARN [BP-574222949-172.31.14.131-1689185647155 heartbeating to localhost/127.0.0.1:38679] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-12 18:17:05,350 WARN [BP-574222949-172.31.14.131-1689185647155 heartbeating to localhost/127.0.0.1:38679] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-574222949-172.31.14.131-1689185647155 (Datanode Uuid c1a88c26-3802-4877-8256-4057a9bd8635) service to localhost/127.0.0.1:38679 2023-07-12 18:17:05,351 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/908563f7-ecc5-f8cf-2e08-f8e1a8353ad0/cluster_816eff0a-2a97-4927-37b9-33079a1e6298/dfs/data/data1/current/BP-574222949-172.31.14.131-1689185647155] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-12 18:17:05,351 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/908563f7-ecc5-f8cf-2e08-f8e1a8353ad0/cluster_816eff0a-2a97-4927-37b9-33079a1e6298/dfs/data/data2/current/BP-574222949-172.31.14.131-1689185647155] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-12 18:17:05,378 INFO [Listener at jenkins-hbase4.apache.org/41393] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-12 18:17:05,520 INFO [Listener at jenkins-hbase4.apache.org/41393] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-12 18:17:05,649 INFO [Listener at jenkins-hbase4.apache.org/41393] hbase.HBaseTestingUtility(1293): Minicluster is down