2023-07-21 20:10:08,184 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-07-21 20:10:08,424 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c4475fbf-6a12-c189-d7a2-889953ef4b74 2023-07-21 20:10:08,425 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobExportSnapshot timeout: 13 mins 2023-07-21 20:10:08,425 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobSecureExportSnapshot timeout: 13 mins 2023-07-21 20:10:08,464 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-21 20:10:08,758 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-21 20:10:08,758 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c4475fbf-6a12-c189-d7a2-889953ef4b74/cluster_35d154ca-3b63-9eae-c963-92b106b8418a, deleteOnExit=true 2023-07-21 20:10:08,759 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-21 20:10:08,759 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c4475fbf-6a12-c189-d7a2-889953ef4b74/test.cache.data in system properties and HBase conf 2023-07-21 20:10:08,760 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c4475fbf-6a12-c189-d7a2-889953ef4b74/hadoop.tmp.dir in system properties and HBase conf 2023-07-21 20:10:08,760 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c4475fbf-6a12-c189-d7a2-889953ef4b74/hadoop.log.dir in system properties and HBase conf 2023-07-21 20:10:08,761 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c4475fbf-6a12-c189-d7a2-889953ef4b74/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-21 20:10:08,762 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c4475fbf-6a12-c189-d7a2-889953ef4b74/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-21 20:10:08,762 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-21 20:10:09,173 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-21 20:10:09,180 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c4475fbf-6a12-c189-d7a2-889953ef4b74/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-21 20:10:09,180 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c4475fbf-6a12-c189-d7a2-889953ef4b74/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-21 20:10:09,181 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c4475fbf-6a12-c189-d7a2-889953ef4b74/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-21 20:10:09,181 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c4475fbf-6a12-c189-d7a2-889953ef4b74/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-21 20:10:09,182 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c4475fbf-6a12-c189-d7a2-889953ef4b74/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-21 20:10:09,182 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c4475fbf-6a12-c189-d7a2-889953ef4b74/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-21 20:10:09,183 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c4475fbf-6a12-c189-d7a2-889953ef4b74/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-21 20:10:09,183 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c4475fbf-6a12-c189-d7a2-889953ef4b74/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-21 20:10:09,184 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c4475fbf-6a12-c189-d7a2-889953ef4b74/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-21 20:10:09,184 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c4475fbf-6a12-c189-d7a2-889953ef4b74/nfs.dump.dir in system properties and HBase conf 2023-07-21 20:10:09,185 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c4475fbf-6a12-c189-d7a2-889953ef4b74/java.io.tmpdir in system properties and HBase conf 2023-07-21 20:10:09,185 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c4475fbf-6a12-c189-d7a2-889953ef4b74/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-21 20:10:09,186 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c4475fbf-6a12-c189-d7a2-889953ef4b74/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-21 20:10:09,186 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c4475fbf-6a12-c189-d7a2-889953ef4b74/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-21 20:10:09,862 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-21 20:10:09,867 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-21 20:10:10,233 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-21 20:10:10,447 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-21 20:10:10,462 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-21 20:10:10,507 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-21 20:10:10,542 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c4475fbf-6a12-c189-d7a2-889953ef4b74/java.io.tmpdir/Jetty_localhost_37835_hdfs____mjqycg/webapp 2023-07-21 20:10:10,728 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37835 2023-07-21 20:10:10,741 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-21 20:10:10,741 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-21 20:10:11,300 WARN [Listener at localhost/40641] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-21 20:10:11,400 WARN [Listener at localhost/40641] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-21 20:10:11,430 WARN [Listener at localhost/40641] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-21 20:10:11,487 INFO [Listener at localhost/40641] log.Slf4jLog(67): jetty-6.1.26 2023-07-21 20:10:11,497 INFO [Listener at localhost/40641] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c4475fbf-6a12-c189-d7a2-889953ef4b74/java.io.tmpdir/Jetty_localhost_38281_datanode____.rmss8j/webapp 2023-07-21 20:10:11,627 INFO [Listener at localhost/40641] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38281 2023-07-21 20:10:12,183 WARN [Listener at localhost/42169] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-21 20:10:12,223 WARN [Listener at localhost/42169] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-21 20:10:12,232 WARN [Listener at localhost/42169] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-21 20:10:12,235 INFO [Listener at localhost/42169] log.Slf4jLog(67): jetty-6.1.26 2023-07-21 20:10:12,246 INFO [Listener at localhost/42169] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c4475fbf-6a12-c189-d7a2-889953ef4b74/java.io.tmpdir/Jetty_localhost_41007_datanode____.t9q2rj/webapp 2023-07-21 20:10:12,359 INFO [Listener at localhost/42169] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41007 2023-07-21 20:10:12,378 WARN [Listener at localhost/35795] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-21 20:10:12,426 WARN [Listener at localhost/35795] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-21 20:10:12,430 WARN [Listener at localhost/35795] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-21 20:10:12,433 INFO [Listener at localhost/35795] log.Slf4jLog(67): jetty-6.1.26 2023-07-21 20:10:12,446 INFO [Listener at localhost/35795] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c4475fbf-6a12-c189-d7a2-889953ef4b74/java.io.tmpdir/Jetty_localhost_39035_datanode____7hhf0z/webapp 2023-07-21 20:10:12,603 INFO [Listener at localhost/35795] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39035 2023-07-21 20:10:12,639 WARN [Listener at localhost/33825] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-21 20:10:13,025 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x89d4cb2f9dd8e7fc: Processing first storage report for DS-54bf5ffe-b0eb-4d2e-a59f-48678e76a8af from datanode fa60e01f-1ec3-4c29-94b6-ebfd47276125 2023-07-21 20:10:13,027 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x89d4cb2f9dd8e7fc: from storage DS-54bf5ffe-b0eb-4d2e-a59f-48678e76a8af node DatanodeRegistration(127.0.0.1:41597, datanodeUuid=fa60e01f-1ec3-4c29-94b6-ebfd47276125, infoPort=37613, infoSecurePort=0, ipcPort=33825, storageInfo=lv=-57;cid=testClusterID;nsid=1232457734;c=1689970209961), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-07-21 20:10:13,028 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x42cbeaa83a5473d2: Processing first storage report for DS-7d02c527-3bf4-47eb-b74d-85f81b654290 from datanode b9a20856-ffe0-44a1-9889-5d68d8863104 2023-07-21 20:10:13,028 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x42cbeaa83a5473d2: from storage DS-7d02c527-3bf4-47eb-b74d-85f81b654290 node DatanodeRegistration(127.0.0.1:46381, datanodeUuid=b9a20856-ffe0-44a1-9889-5d68d8863104, infoPort=36283, infoSecurePort=0, ipcPort=35795, storageInfo=lv=-57;cid=testClusterID;nsid=1232457734;c=1689970209961), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-21 20:10:13,028 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xaf1e8481807c5299: Processing first storage report for DS-2fdd07fc-7f56-4522-b412-521019925a4c from datanode 366e2780-2b85-44d9-b6b1-c9e82da1bd13 2023-07-21 20:10:13,028 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xaf1e8481807c5299: from storage DS-2fdd07fc-7f56-4522-b412-521019925a4c node DatanodeRegistration(127.0.0.1:36137, datanodeUuid=366e2780-2b85-44d9-b6b1-c9e82da1bd13, infoPort=36297, infoSecurePort=0, ipcPort=42169, storageInfo=lv=-57;cid=testClusterID;nsid=1232457734;c=1689970209961), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-21 20:10:13,028 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x89d4cb2f9dd8e7fc: Processing first storage report for DS-363b7fa2-23ea-4491-9435-7be6e84cc74a from datanode fa60e01f-1ec3-4c29-94b6-ebfd47276125 2023-07-21 20:10:13,028 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x89d4cb2f9dd8e7fc: from storage DS-363b7fa2-23ea-4491-9435-7be6e84cc74a node DatanodeRegistration(127.0.0.1:41597, datanodeUuid=fa60e01f-1ec3-4c29-94b6-ebfd47276125, infoPort=37613, infoSecurePort=0, ipcPort=33825, storageInfo=lv=-57;cid=testClusterID;nsid=1232457734;c=1689970209961), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-21 20:10:13,028 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x42cbeaa83a5473d2: Processing first storage report for DS-d615504f-9aae-41fb-8911-2395d9e40f3c from datanode b9a20856-ffe0-44a1-9889-5d68d8863104 2023-07-21 20:10:13,028 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x42cbeaa83a5473d2: from storage DS-d615504f-9aae-41fb-8911-2395d9e40f3c node DatanodeRegistration(127.0.0.1:46381, datanodeUuid=b9a20856-ffe0-44a1-9889-5d68d8863104, infoPort=36283, infoSecurePort=0, ipcPort=35795, storageInfo=lv=-57;cid=testClusterID;nsid=1232457734;c=1689970209961), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-21 20:10:13,029 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xaf1e8481807c5299: Processing first storage report for DS-d59148ad-21ec-4371-9a6b-c2d39568a758 from datanode 366e2780-2b85-44d9-b6b1-c9e82da1bd13 2023-07-21 20:10:13,029 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xaf1e8481807c5299: from storage DS-d59148ad-21ec-4371-9a6b-c2d39568a758 node DatanodeRegistration(127.0.0.1:36137, datanodeUuid=366e2780-2b85-44d9-b6b1-c9e82da1bd13, infoPort=36297, infoSecurePort=0, ipcPort=42169, storageInfo=lv=-57;cid=testClusterID;nsid=1232457734;c=1689970209961), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-21 20:10:13,254 DEBUG [Listener at localhost/33825] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c4475fbf-6a12-c189-d7a2-889953ef4b74 2023-07-21 20:10:13,351 INFO [Listener at localhost/33825] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c4475fbf-6a12-c189-d7a2-889953ef4b74/cluster_35d154ca-3b63-9eae-c963-92b106b8418a/zookeeper_0, clientPort=59101, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c4475fbf-6a12-c189-d7a2-889953ef4b74/cluster_35d154ca-3b63-9eae-c963-92b106b8418a/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c4475fbf-6a12-c189-d7a2-889953ef4b74/cluster_35d154ca-3b63-9eae-c963-92b106b8418a/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-21 20:10:13,389 INFO [Listener at localhost/33825] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=59101 2023-07-21 20:10:13,401 INFO [Listener at localhost/33825] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-21 20:10:13,404 INFO [Listener at localhost/33825] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-21 20:10:14,136 INFO [Listener at localhost/33825] util.FSUtils(471): Created version file at hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00 with version=8 2023-07-21 20:10:14,136 INFO [Listener at localhost/33825] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/hbase-staging 2023-07-21 20:10:14,555 INFO [Listener at localhost/33825] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-21 20:10:15,197 INFO [Listener at localhost/33825] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-07-21 20:10:15,231 INFO [Listener at localhost/33825] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-21 20:10:15,231 INFO [Listener at localhost/33825] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-21 20:10:15,231 INFO [Listener at localhost/33825] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-21 20:10:15,231 INFO [Listener at localhost/33825] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-21 20:10:15,232 INFO [Listener at localhost/33825] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-21 20:10:15,389 INFO [Listener at localhost/33825] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-21 20:10:15,476 DEBUG [Listener at localhost/33825] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-21 20:10:15,572 INFO [Listener at localhost/33825] ipc.NettyRpcServer(120): Bind to /172.31.14.131:41777 2023-07-21 20:10:15,586 INFO [Listener at localhost/33825] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-21 20:10:15,589 INFO [Listener at localhost/33825] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-21 20:10:15,616 INFO [Listener at localhost/33825] zookeeper.RecoverableZooKeeper(93): Process identifier=master:41777 connecting to ZooKeeper ensemble=127.0.0.1:59101 2023-07-21 20:10:15,708 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:417770x0, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-21 20:10:15,715 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:41777-0x101898184d10000 connected 2023-07-21 20:10:15,785 DEBUG [Listener at localhost/33825] zookeeper.ZKUtil(164): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-21 20:10:15,786 DEBUG [Listener at localhost/33825] zookeeper.ZKUtil(164): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-21 20:10:15,803 DEBUG [Listener at localhost/33825] zookeeper.ZKUtil(164): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-21 20:10:15,816 DEBUG [Listener at localhost/33825] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41777 2023-07-21 20:10:15,822 DEBUG [Listener at localhost/33825] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41777 2023-07-21 20:10:15,830 DEBUG [Listener at localhost/33825] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41777 2023-07-21 20:10:15,838 DEBUG [Listener at localhost/33825] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41777 2023-07-21 20:10:15,839 DEBUG [Listener at localhost/33825] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41777 2023-07-21 20:10:15,849 INFO [Listener at localhost/33825] master.HMaster(444): hbase.rootdir=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00, hbase.cluster.distributed=false 2023-07-21 20:10:15,928 INFO [Listener at localhost/33825] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-21 20:10:15,929 INFO [Listener at localhost/33825] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-21 20:10:15,929 INFO [Listener at localhost/33825] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-21 20:10:15,929 INFO [Listener at localhost/33825] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-21 20:10:15,929 INFO [Listener at localhost/33825] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-21 20:10:15,929 INFO [Listener at localhost/33825] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-21 20:10:15,934 INFO [Listener at localhost/33825] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-21 20:10:15,943 INFO [Listener at localhost/33825] ipc.NettyRpcServer(120): Bind to /172.31.14.131:40099 2023-07-21 20:10:15,949 INFO [Listener at localhost/33825] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-21 20:10:15,972 INFO [Listener at localhost/33825] mob.MobFileCache(124): MobFileCache disabled 2023-07-21 20:10:15,974 INFO [Listener at localhost/33825] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-21 20:10:15,978 INFO [Listener at localhost/33825] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-21 20:10:15,980 INFO [Listener at localhost/33825] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:40099 connecting to ZooKeeper ensemble=127.0.0.1:59101 2023-07-21 20:10:15,986 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:400990x0, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-21 20:10:15,990 DEBUG [Listener at localhost/33825] zookeeper.ZKUtil(164): regionserver:400990x0, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-21 20:10:15,997 DEBUG [Listener at localhost/33825] zookeeper.ZKUtil(164): regionserver:400990x0, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-21 20:10:15,998 DEBUG [Listener at localhost/33825] zookeeper.ZKUtil(164): regionserver:400990x0, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-21 20:10:16,000 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:40099-0x101898184d10001 connected 2023-07-21 20:10:16,000 DEBUG [Listener at localhost/33825] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40099 2023-07-21 20:10:16,000 DEBUG [Listener at localhost/33825] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40099 2023-07-21 20:10:16,001 DEBUG [Listener at localhost/33825] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40099 2023-07-21 20:10:16,002 DEBUG [Listener at localhost/33825] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40099 2023-07-21 20:10:16,002 DEBUG [Listener at localhost/33825] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40099 2023-07-21 20:10:16,018 INFO [Listener at localhost/33825] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-21 20:10:16,019 INFO [Listener at localhost/33825] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-21 20:10:16,019 INFO [Listener at localhost/33825] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-21 20:10:16,020 INFO [Listener at localhost/33825] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-21 20:10:16,020 INFO [Listener at localhost/33825] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-21 20:10:16,020 INFO [Listener at localhost/33825] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-21 20:10:16,020 INFO [Listener at localhost/33825] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-21 20:10:16,022 INFO [Listener at localhost/33825] ipc.NettyRpcServer(120): Bind to /172.31.14.131:37823 2023-07-21 20:10:16,022 INFO [Listener at localhost/33825] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-21 20:10:16,028 INFO [Listener at localhost/33825] mob.MobFileCache(124): MobFileCache disabled 2023-07-21 20:10:16,028 INFO [Listener at localhost/33825] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-21 20:10:16,031 INFO [Listener at localhost/33825] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-21 20:10:16,034 INFO [Listener at localhost/33825] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:37823 connecting to ZooKeeper ensemble=127.0.0.1:59101 2023-07-21 20:10:16,041 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:378230x0, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-21 20:10:16,042 DEBUG [Listener at localhost/33825] zookeeper.ZKUtil(164): regionserver:378230x0, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-21 20:10:16,043 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:37823-0x101898184d10002 connected 2023-07-21 20:10:16,043 DEBUG [Listener at localhost/33825] zookeeper.ZKUtil(164): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-21 20:10:16,044 DEBUG [Listener at localhost/33825] zookeeper.ZKUtil(164): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-21 20:10:16,051 DEBUG [Listener at localhost/33825] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=37823 2023-07-21 20:10:16,051 DEBUG [Listener at localhost/33825] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=37823 2023-07-21 20:10:16,052 DEBUG [Listener at localhost/33825] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=37823 2023-07-21 20:10:16,052 DEBUG [Listener at localhost/33825] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=37823 2023-07-21 20:10:16,053 DEBUG [Listener at localhost/33825] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=37823 2023-07-21 20:10:16,066 INFO [Listener at localhost/33825] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-21 20:10:16,066 INFO [Listener at localhost/33825] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-21 20:10:16,066 INFO [Listener at localhost/33825] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-21 20:10:16,067 INFO [Listener at localhost/33825] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-21 20:10:16,067 INFO [Listener at localhost/33825] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-21 20:10:16,067 INFO [Listener at localhost/33825] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-21 20:10:16,067 INFO [Listener at localhost/33825] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-21 20:10:16,071 INFO [Listener at localhost/33825] ipc.NettyRpcServer(120): Bind to /172.31.14.131:34071 2023-07-21 20:10:16,071 INFO [Listener at localhost/33825] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-21 20:10:16,074 INFO [Listener at localhost/33825] mob.MobFileCache(124): MobFileCache disabled 2023-07-21 20:10:16,076 INFO [Listener at localhost/33825] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-21 20:10:16,077 INFO [Listener at localhost/33825] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-21 20:10:16,078 INFO [Listener at localhost/33825] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:34071 connecting to ZooKeeper ensemble=127.0.0.1:59101 2023-07-21 20:10:16,084 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:340710x0, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-21 20:10:16,085 DEBUG [Listener at localhost/33825] zookeeper.ZKUtil(164): regionserver:340710x0, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-21 20:10:16,086 DEBUG [Listener at localhost/33825] zookeeper.ZKUtil(164): regionserver:340710x0, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-21 20:10:16,087 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:34071-0x101898184d10003 connected 2023-07-21 20:10:16,087 DEBUG [Listener at localhost/33825] zookeeper.ZKUtil(164): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-21 20:10:16,091 DEBUG [Listener at localhost/33825] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=34071 2023-07-21 20:10:16,091 DEBUG [Listener at localhost/33825] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=34071 2023-07-21 20:10:16,094 DEBUG [Listener at localhost/33825] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=34071 2023-07-21 20:10:16,097 DEBUG [Listener at localhost/33825] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=34071 2023-07-21 20:10:16,097 DEBUG [Listener at localhost/33825] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=34071 2023-07-21 20:10:16,099 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,41777,1689970214362 2023-07-21 20:10:16,111 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-21 20:10:16,112 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,41777,1689970214362 2023-07-21 20:10:16,136 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-21 20:10:16,136 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-21 20:10:16,136 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-21 20:10:16,136 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-21 20:10:16,138 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-21 20:10:16,138 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-21 20:10:16,144 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,41777,1689970214362 from backup master directory 2023-07-21 20:10:16,145 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-21 20:10:16,150 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,41777,1689970214362 2023-07-21 20:10:16,150 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-21 20:10:16,151 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-21 20:10:16,151 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,41777,1689970214362 2023-07-21 20:10:16,155 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-21 20:10:16,158 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-21 20:10:16,290 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/hbase.id with ID: 50307f55-d62c-4f4a-883c-092f097c1d08 2023-07-21 20:10:16,364 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-21 20:10:16,386 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-21 20:10:16,475 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x049d6ab6 to 127.0.0.1:59101 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 20:10:16,518 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@76754ddf, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 20:10:16,546 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-21 20:10:16,548 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-21 20:10:16,568 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-21 20:10:16,568 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-21 20:10:16,571 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-21 20:10:16,576 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-21 20:10:16,577 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-21 20:10:16,632 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/MasterData/data/master/store-tmp 2023-07-21 20:10:16,691 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 20:10:16,691 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-21 20:10:16,691 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-21 20:10:16,692 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-21 20:10:16,692 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-21 20:10:16,692 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-21 20:10:16,692 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-21 20:10:16,692 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-21 20:10:16,694 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/MasterData/WALs/jenkins-hbase4.apache.org,41777,1689970214362 2023-07-21 20:10:16,720 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41777%2C1689970214362, suffix=, logDir=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/MasterData/WALs/jenkins-hbase4.apache.org,41777,1689970214362, archiveDir=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/MasterData/oldWALs, maxLogs=10 2023-07-21 20:10:16,807 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46381,DS-7d02c527-3bf4-47eb-b74d-85f81b654290,DISK] 2023-07-21 20:10:16,807 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36137,DS-2fdd07fc-7f56-4522-b412-521019925a4c,DISK] 2023-07-21 20:10:16,816 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41597,DS-54bf5ffe-b0eb-4d2e-a59f-48678e76a8af,DISK] 2023-07-21 20:10:16,824 DEBUG [RS-EventLoopGroup-5-3] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-21 20:10:16,938 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/MasterData/WALs/jenkins-hbase4.apache.org,41777,1689970214362/jenkins-hbase4.apache.org%2C41777%2C1689970214362.1689970216733 2023-07-21 20:10:16,943 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46381,DS-7d02c527-3bf4-47eb-b74d-85f81b654290,DISK], DatanodeInfoWithStorage[127.0.0.1:41597,DS-54bf5ffe-b0eb-4d2e-a59f-48678e76a8af,DISK], DatanodeInfoWithStorage[127.0.0.1:36137,DS-2fdd07fc-7f56-4522-b412-521019925a4c,DISK]] 2023-07-21 20:10:16,944 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-21 20:10:16,944 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 20:10:16,949 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-21 20:10:16,951 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-21 20:10:17,044 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-21 20:10:17,053 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-21 20:10:17,088 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-21 20:10:17,100 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 20:10:17,106 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-21 20:10:17,108 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-21 20:10:17,125 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-21 20:10:17,130 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-21 20:10:17,131 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60152261, jitterRate=-0.10366146266460419}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-21 20:10:17,131 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-21 20:10:17,132 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-21 20:10:17,160 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-21 20:10:17,161 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-21 20:10:17,165 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-21 20:10:17,167 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-21 20:10:17,205 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 37 msec 2023-07-21 20:10:17,205 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-21 20:10:17,238 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-21 20:10:17,244 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-21 20:10:17,273 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-21 20:10:17,281 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-21 20:10:17,283 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-21 20:10:17,291 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-21 20:10:17,297 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-21 20:10:17,301 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-21 20:10:17,303 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-21 20:10:17,303 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-21 20:10:17,318 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-21 20:10:17,323 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-21 20:10:17,323 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-21 20:10:17,323 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-21 20:10:17,323 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-21 20:10:17,323 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-21 20:10:17,325 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,41777,1689970214362, sessionid=0x101898184d10000, setting cluster-up flag (Was=false) 2023-07-21 20:10:17,344 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-21 20:10:17,350 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-21 20:10:17,352 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,41777,1689970214362 2023-07-21 20:10:17,359 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-21 20:10:17,368 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-21 20:10:17,370 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,41777,1689970214362 2023-07-21 20:10:17,373 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.hbase-snapshot/.tmp 2023-07-21 20:10:17,404 INFO [RS:1;jenkins-hbase4:37823] regionserver.HRegionServer(951): ClusterId : 50307f55-d62c-4f4a-883c-092f097c1d08 2023-07-21 20:10:17,405 INFO [RS:0;jenkins-hbase4:40099] regionserver.HRegionServer(951): ClusterId : 50307f55-d62c-4f4a-883c-092f097c1d08 2023-07-21 20:10:17,421 INFO [RS:2;jenkins-hbase4:34071] regionserver.HRegionServer(951): ClusterId : 50307f55-d62c-4f4a-883c-092f097c1d08 2023-07-21 20:10:17,424 DEBUG [RS:0;jenkins-hbase4:40099] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-21 20:10:17,424 DEBUG [RS:1;jenkins-hbase4:37823] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-21 20:10:17,425 DEBUG [RS:2;jenkins-hbase4:34071] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-21 20:10:17,434 DEBUG [RS:2;jenkins-hbase4:34071] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-21 20:10:17,434 DEBUG [RS:0;jenkins-hbase4:40099] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-21 20:10:17,434 DEBUG [RS:0;jenkins-hbase4:40099] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-21 20:10:17,434 DEBUG [RS:1;jenkins-hbase4:37823] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-21 20:10:17,434 DEBUG [RS:2;jenkins-hbase4:34071] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-21 20:10:17,434 DEBUG [RS:1;jenkins-hbase4:37823] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-21 20:10:17,441 DEBUG [RS:2;jenkins-hbase4:34071] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-21 20:10:17,443 DEBUG [RS:2;jenkins-hbase4:34071] zookeeper.ReadOnlyZKClient(139): Connect 0x20ad8ddf to 127.0.0.1:59101 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 20:10:17,447 DEBUG [RS:0;jenkins-hbase4:40099] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-21 20:10:17,447 DEBUG [RS:1;jenkins-hbase4:37823] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-21 20:10:17,461 DEBUG [RS:1;jenkins-hbase4:37823] zookeeper.ReadOnlyZKClient(139): Connect 0x00fdec25 to 127.0.0.1:59101 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 20:10:17,463 DEBUG [RS:0;jenkins-hbase4:40099] zookeeper.ReadOnlyZKClient(139): Connect 0x666c3de0 to 127.0.0.1:59101 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 20:10:17,474 DEBUG [RS:2;jenkins-hbase4:34071] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2e6a67ba, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 20:10:17,475 DEBUG [RS:2;jenkins-hbase4:34071] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2a55e6af, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-21 20:10:17,488 DEBUG [RS:1;jenkins-hbase4:37823] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@e3a124a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 20:10:17,488 DEBUG [RS:1;jenkins-hbase4:37823] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@a058755, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-21 20:10:17,518 DEBUG [RS:0;jenkins-hbase4:40099] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@68abcf5d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 20:10:17,518 DEBUG [RS:0;jenkins-hbase4:40099] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6c945690, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-21 20:10:17,532 DEBUG [RS:2;jenkins-hbase4:34071] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:34071 2023-07-21 20:10:17,533 DEBUG [RS:1;jenkins-hbase4:37823] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:37823 2023-07-21 20:10:17,535 DEBUG [RS:0;jenkins-hbase4:40099] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:40099 2023-07-21 20:10:17,541 INFO [RS:2;jenkins-hbase4:34071] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-21 20:10:17,542 INFO [RS:1;jenkins-hbase4:37823] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-21 20:10:17,543 INFO [RS:1;jenkins-hbase4:37823] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-21 20:10:17,541 INFO [RS:0;jenkins-hbase4:40099] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-21 20:10:17,542 INFO [RS:2;jenkins-hbase4:34071] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-21 20:10:17,547 INFO [RS:0;jenkins-hbase4:40099] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-21 20:10:17,556 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-07-21 20:10:17,557 DEBUG [RS:0;jenkins-hbase4:40099] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-21 20:10:17,558 DEBUG [RS:2;jenkins-hbase4:34071] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-21 20:10:17,558 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 20:10:17,559 DEBUG [RS:1;jenkins-hbase4:37823] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-21 20:10:17,559 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-07-21 20:10:17,559 INFO [RS:2;jenkins-hbase4:34071] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 20:10:17,560 INFO [RS:0;jenkins-hbase4:40099] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 20:10:17,560 DEBUG [RS:2;jenkins-hbase4:34071] regionserver.HRegionServer(1022): About to register with Master. 2023-07-21 20:10:17,559 INFO [RS:1;jenkins-hbase4:37823] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 20:10:17,560 DEBUG [RS:1;jenkins-hbase4:37823] regionserver.HRegionServer(1022): About to register with Master. 2023-07-21 20:10:17,560 DEBUG [RS:0;jenkins-hbase4:40099] regionserver.HRegionServer(1022): About to register with Master. 2023-07-21 20:10:17,564 INFO [RS:2;jenkins-hbase4:34071] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,41777,1689970214362 with isa=jenkins-hbase4.apache.org/172.31.14.131:34071, startcode=1689970216065 2023-07-21 20:10:17,564 INFO [RS:1;jenkins-hbase4:37823] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,41777,1689970214362 with isa=jenkins-hbase4.apache.org/172.31.14.131:37823, startcode=1689970216018 2023-07-21 20:10:17,564 INFO [RS:0;jenkins-hbase4:40099] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,41777,1689970214362 with isa=jenkins-hbase4.apache.org/172.31.14.131:40099, startcode=1689970215928 2023-07-21 20:10:17,589 DEBUG [RS:0;jenkins-hbase4:40099] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-21 20:10:17,591 DEBUG [RS:2;jenkins-hbase4:34071] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-21 20:10:17,591 DEBUG [RS:1;jenkins-hbase4:37823] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-21 20:10:17,669 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44393, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-07-21 20:10:17,670 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43259, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-07-21 20:10:17,670 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36597, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-21 20:10:17,679 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-21 20:10:17,679 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41777] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-21 20:10:17,688 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41777] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-21 20:10:17,689 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41777] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-21 20:10:17,690 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-21 20:10:17,691 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-21 20:10:17,691 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-21 20:10:17,691 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-21 20:10:17,691 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-07-21 20:10:17,691 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-21 20:10:17,691 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-21 20:10:17,691 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-21 20:10:17,693 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689970247693 2023-07-21 20:10:17,707 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-21 20:10:17,725 DEBUG [RS:0;jenkins-hbase4:40099] regionserver.HRegionServer(2830): Master is not running yet 2023-07-21 20:10:17,726 WARN [RS:0;jenkins-hbase4:40099] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-21 20:10:17,727 DEBUG [RS:1;jenkins-hbase4:37823] regionserver.HRegionServer(2830): Master is not running yet 2023-07-21 20:10:17,727 WARN [RS:1;jenkins-hbase4:37823] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-21 20:10:17,727 DEBUG [RS:2;jenkins-hbase4:34071] regionserver.HRegionServer(2830): Master is not running yet 2023-07-21 20:10:17,727 WARN [RS:2;jenkins-hbase4:34071] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-21 20:10:17,731 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-21 20:10:17,732 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-21 20:10:17,736 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-21 20:10:17,744 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-21 20:10:17,749 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-21 20:10:17,750 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-21 20:10:17,750 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-21 20:10:17,751 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-21 20:10:17,753 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-21 20:10:17,755 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-21 20:10:17,757 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-21 20:10:17,758 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-21 20:10:17,765 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-21 20:10:17,766 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-21 20:10:17,781 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689970217768,5,FailOnTimeoutGroup] 2023-07-21 20:10:17,783 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689970217782,5,FailOnTimeoutGroup] 2023-07-21 20:10:17,783 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-21 20:10:17,784 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-21 20:10:17,785 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-21 20:10:17,786 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-21 20:10:17,824 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-21 20:10:17,826 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-21 20:10:17,826 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00 2023-07-21 20:10:17,828 INFO [RS:1;jenkins-hbase4:37823] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,41777,1689970214362 with isa=jenkins-hbase4.apache.org/172.31.14.131:37823, startcode=1689970216018 2023-07-21 20:10:17,829 INFO [RS:2;jenkins-hbase4:34071] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,41777,1689970214362 with isa=jenkins-hbase4.apache.org/172.31.14.131:34071, startcode=1689970216065 2023-07-21 20:10:17,835 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41777] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:10:17,837 INFO [RS:0;jenkins-hbase4:40099] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,41777,1689970214362 with isa=jenkins-hbase4.apache.org/172.31.14.131:40099, startcode=1689970215928 2023-07-21 20:10:17,841 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41777] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:10:17,841 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41777] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:10:17,845 DEBUG [RS:0;jenkins-hbase4:40099] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00 2023-07-21 20:10:17,845 DEBUG [RS:2;jenkins-hbase4:34071] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00 2023-07-21 20:10:17,845 DEBUG [RS:1;jenkins-hbase4:37823] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00 2023-07-21 20:10:17,845 DEBUG [RS:2;jenkins-hbase4:34071] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:40641 2023-07-21 20:10:17,845 DEBUG [RS:0;jenkins-hbase4:40099] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:40641 2023-07-21 20:10:17,845 DEBUG [RS:2;jenkins-hbase4:34071] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-21 20:10:17,845 DEBUG [RS:1;jenkins-hbase4:37823] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:40641 2023-07-21 20:10:17,845 DEBUG [RS:0;jenkins-hbase4:40099] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-21 20:10:17,845 DEBUG [RS:1;jenkins-hbase4:37823] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-21 20:10:17,854 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-21 20:10:17,862 DEBUG [RS:0;jenkins-hbase4:40099] zookeeper.ZKUtil(162): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:10:17,862 WARN [RS:0;jenkins-hbase4:40099] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-21 20:10:17,862 INFO [RS:0;jenkins-hbase4:40099] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-21 20:10:17,863 DEBUG [RS:2;jenkins-hbase4:34071] zookeeper.ZKUtil(162): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:10:17,863 DEBUG [RS:0;jenkins-hbase4:40099] regionserver.HRegionServer(1948): logDir=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/WALs/jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:10:17,863 WARN [RS:2;jenkins-hbase4:34071] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-21 20:10:17,863 DEBUG [RS:1;jenkins-hbase4:37823] zookeeper.ZKUtil(162): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:10:17,863 INFO [RS:2;jenkins-hbase4:34071] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-21 20:10:17,863 WARN [RS:1;jenkins-hbase4:37823] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-21 20:10:17,864 DEBUG [RS:2;jenkins-hbase4:34071] regionserver.HRegionServer(1948): logDir=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/WALs/jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:10:17,864 INFO [RS:1;jenkins-hbase4:37823] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-21 20:10:17,865 DEBUG [RS:1;jenkins-hbase4:37823] regionserver.HRegionServer(1948): logDir=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/WALs/jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:10:17,863 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,37823,1689970216018] 2023-07-21 20:10:17,868 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,40099,1689970215928] 2023-07-21 20:10:17,868 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,34071,1689970216065] 2023-07-21 20:10:17,877 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 20:10:17,882 DEBUG [RS:1;jenkins-hbase4:37823] zookeeper.ZKUtil(162): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:10:17,882 DEBUG [RS:0;jenkins-hbase4:40099] zookeeper.ZKUtil(162): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:10:17,882 DEBUG [RS:2;jenkins-hbase4:34071] zookeeper.ZKUtil(162): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:10:17,883 DEBUG [RS:1;jenkins-hbase4:37823] zookeeper.ZKUtil(162): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:10:17,883 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-21 20:10:17,883 DEBUG [RS:2;jenkins-hbase4:34071] zookeeper.ZKUtil(162): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:10:17,883 DEBUG [RS:0;jenkins-hbase4:40099] zookeeper.ZKUtil(162): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:10:17,884 DEBUG [RS:1;jenkins-hbase4:37823] zookeeper.ZKUtil(162): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:10:17,884 DEBUG [RS:0;jenkins-hbase4:40099] zookeeper.ZKUtil(162): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:10:17,884 DEBUG [RS:2;jenkins-hbase4:34071] zookeeper.ZKUtil(162): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:10:17,887 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/hbase/meta/1588230740/info 2023-07-21 20:10:17,888 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-21 20:10:17,890 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 20:10:17,891 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-21 20:10:17,894 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/hbase/meta/1588230740/rep_barrier 2023-07-21 20:10:17,895 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-21 20:10:17,896 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 20:10:17,896 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-21 20:10:17,898 DEBUG [RS:1;jenkins-hbase4:37823] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-21 20:10:17,898 DEBUG [RS:2;jenkins-hbase4:34071] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-21 20:10:17,898 DEBUG [RS:0;jenkins-hbase4:40099] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-21 20:10:17,900 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/hbase/meta/1588230740/table 2023-07-21 20:10:17,901 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-21 20:10:17,902 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 20:10:17,904 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/hbase/meta/1588230740 2023-07-21 20:10:17,906 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/hbase/meta/1588230740 2023-07-21 20:10:17,911 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-21 20:10:17,914 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-21 20:10:17,919 INFO [RS:0;jenkins-hbase4:40099] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-21 20:10:17,919 INFO [RS:1;jenkins-hbase4:37823] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-21 20:10:17,919 INFO [RS:2;jenkins-hbase4:34071] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-21 20:10:17,934 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-21 20:10:17,935 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68846730, jitterRate=0.02589622139930725}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-21 20:10:17,936 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-21 20:10:17,936 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-21 20:10:17,936 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-21 20:10:17,936 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-21 20:10:17,936 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-21 20:10:17,936 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-21 20:10:17,941 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-21 20:10:17,942 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-21 20:10:17,959 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-21 20:10:17,959 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-21 20:10:17,969 INFO [RS:1;jenkins-hbase4:37823] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-21 20:10:17,969 INFO [RS:0;jenkins-hbase4:40099] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-21 20:10:17,969 INFO [RS:2;jenkins-hbase4:34071] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-21 20:10:17,975 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-21 20:10:17,976 INFO [RS:0;jenkins-hbase4:40099] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-21 20:10:17,976 INFO [RS:0;jenkins-hbase4:40099] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-21 20:10:17,982 INFO [RS:1;jenkins-hbase4:37823] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-21 20:10:17,983 INFO [RS:1;jenkins-hbase4:37823] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-21 20:10:17,983 INFO [RS:2;jenkins-hbase4:34071] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-21 20:10:17,983 INFO [RS:2;jenkins-hbase4:34071] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-21 20:10:17,984 INFO [RS:0;jenkins-hbase4:40099] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-21 20:10:17,990 INFO [RS:1;jenkins-hbase4:37823] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-21 20:10:17,993 INFO [RS:2;jenkins-hbase4:34071] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-21 20:10:18,001 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-21 20:10:18,005 INFO [RS:0;jenkins-hbase4:40099] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-21 20:10:18,005 INFO [RS:2;jenkins-hbase4:34071] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-21 20:10:18,006 DEBUG [RS:0;jenkins-hbase4:40099] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-21 20:10:18,005 INFO [RS:1;jenkins-hbase4:37823] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-21 20:10:18,007 DEBUG [RS:0;jenkins-hbase4:40099] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-21 20:10:18,006 DEBUG [RS:2;jenkins-hbase4:34071] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-21 20:10:18,008 DEBUG [RS:0;jenkins-hbase4:40099] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-21 20:10:18,008 DEBUG [RS:2;jenkins-hbase4:34071] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-21 20:10:18,008 DEBUG [RS:0;jenkins-hbase4:40099] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-21 20:10:18,008 DEBUG [RS:2;jenkins-hbase4:34071] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-21 20:10:18,008 DEBUG [RS:0;jenkins-hbase4:40099] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-21 20:10:18,006 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-21 20:10:18,008 DEBUG [RS:0;jenkins-hbase4:40099] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-21 20:10:18,008 DEBUG [RS:2;jenkins-hbase4:34071] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-21 20:10:18,008 DEBUG [RS:0;jenkins-hbase4:40099] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-21 20:10:18,008 DEBUG [RS:2;jenkins-hbase4:34071] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-21 20:10:18,007 DEBUG [RS:1;jenkins-hbase4:37823] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-21 20:10:18,009 DEBUG [RS:2;jenkins-hbase4:34071] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-21 20:10:18,009 DEBUG [RS:1;jenkins-hbase4:37823] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-21 20:10:18,009 DEBUG [RS:2;jenkins-hbase4:34071] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-21 20:10:18,009 DEBUG [RS:1;jenkins-hbase4:37823] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-21 20:10:18,009 DEBUG [RS:2;jenkins-hbase4:34071] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-21 20:10:18,009 DEBUG [RS:1;jenkins-hbase4:37823] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-21 20:10:18,009 DEBUG [RS:2;jenkins-hbase4:34071] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-21 20:10:18,009 DEBUG [RS:1;jenkins-hbase4:37823] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-21 20:10:18,009 DEBUG [RS:0;jenkins-hbase4:40099] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-21 20:10:18,009 DEBUG [RS:2;jenkins-hbase4:34071] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-21 20:10:18,010 DEBUG [RS:0;jenkins-hbase4:40099] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-21 20:10:18,010 DEBUG [RS:0;jenkins-hbase4:40099] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-21 20:10:18,010 DEBUG [RS:1;jenkins-hbase4:37823] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-21 20:10:18,010 DEBUG [RS:1;jenkins-hbase4:37823] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-21 20:10:18,011 DEBUG [RS:1;jenkins-hbase4:37823] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-21 20:10:18,011 DEBUG [RS:1;jenkins-hbase4:37823] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-21 20:10:18,011 DEBUG [RS:1;jenkins-hbase4:37823] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-21 20:10:18,032 INFO [RS:0;jenkins-hbase4:40099] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-21 20:10:18,033 INFO [RS:0;jenkins-hbase4:40099] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-21 20:10:18,033 INFO [RS:0;jenkins-hbase4:40099] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-21 20:10:18,039 INFO [RS:2;jenkins-hbase4:34071] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-21 20:10:18,039 INFO [RS:2;jenkins-hbase4:34071] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-21 20:10:18,039 INFO [RS:2;jenkins-hbase4:34071] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-21 20:10:18,051 INFO [RS:1;jenkins-hbase4:37823] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-21 20:10:18,051 INFO [RS:1;jenkins-hbase4:37823] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-21 20:10:18,051 INFO [RS:1;jenkins-hbase4:37823] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-21 20:10:18,069 INFO [RS:0;jenkins-hbase4:40099] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-21 20:10:18,072 INFO [RS:0;jenkins-hbase4:40099] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40099,1689970215928-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-21 20:10:18,097 INFO [RS:2;jenkins-hbase4:34071] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-21 20:10:18,098 INFO [RS:2;jenkins-hbase4:34071] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34071,1689970216065-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-21 20:10:18,106 INFO [RS:0;jenkins-hbase4:40099] regionserver.Replication(203): jenkins-hbase4.apache.org,40099,1689970215928 started 2023-07-21 20:10:18,106 INFO [RS:1;jenkins-hbase4:37823] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-21 20:10:18,106 INFO [RS:0;jenkins-hbase4:40099] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,40099,1689970215928, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:40099, sessionid=0x101898184d10001 2023-07-21 20:10:18,106 INFO [RS:1;jenkins-hbase4:37823] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37823,1689970216018-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-21 20:10:18,107 DEBUG [RS:0;jenkins-hbase4:40099] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-21 20:10:18,107 DEBUG [RS:0;jenkins-hbase4:40099] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:10:18,107 DEBUG [RS:0;jenkins-hbase4:40099] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40099,1689970215928' 2023-07-21 20:10:18,107 DEBUG [RS:0;jenkins-hbase4:40099] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-21 20:10:18,111 DEBUG [RS:0;jenkins-hbase4:40099] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-21 20:10:18,112 DEBUG [RS:0;jenkins-hbase4:40099] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-21 20:10:18,112 DEBUG [RS:0;jenkins-hbase4:40099] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-21 20:10:18,112 DEBUG [RS:0;jenkins-hbase4:40099] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:10:18,112 DEBUG [RS:0;jenkins-hbase4:40099] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40099,1689970215928' 2023-07-21 20:10:18,112 DEBUG [RS:0;jenkins-hbase4:40099] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:10:18,113 DEBUG [RS:0;jenkins-hbase4:40099] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:10:18,114 DEBUG [RS:0;jenkins-hbase4:40099] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-21 20:10:18,119 INFO [RS:0;jenkins-hbase4:40099] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-21 20:10:18,120 INFO [RS:0;jenkins-hbase4:40099] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-21 20:10:18,122 INFO [RS:1;jenkins-hbase4:37823] regionserver.Replication(203): jenkins-hbase4.apache.org,37823,1689970216018 started 2023-07-21 20:10:18,122 INFO [RS:1;jenkins-hbase4:37823] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,37823,1689970216018, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:37823, sessionid=0x101898184d10002 2023-07-21 20:10:18,122 DEBUG [RS:1;jenkins-hbase4:37823] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-21 20:10:18,122 DEBUG [RS:1;jenkins-hbase4:37823] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:10:18,123 DEBUG [RS:1;jenkins-hbase4:37823] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,37823,1689970216018' 2023-07-21 20:10:18,124 DEBUG [RS:1;jenkins-hbase4:37823] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-21 20:10:18,125 DEBUG [RS:1;jenkins-hbase4:37823] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-21 20:10:18,126 DEBUG [RS:1;jenkins-hbase4:37823] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-21 20:10:18,126 DEBUG [RS:1;jenkins-hbase4:37823] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-21 20:10:18,134 INFO [RS:2;jenkins-hbase4:34071] regionserver.Replication(203): jenkins-hbase4.apache.org,34071,1689970216065 started 2023-07-21 20:10:18,135 INFO [RS:2;jenkins-hbase4:34071] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,34071,1689970216065, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:34071, sessionid=0x101898184d10003 2023-07-21 20:10:18,135 DEBUG [RS:2;jenkins-hbase4:34071] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-21 20:10:18,135 DEBUG [RS:2;jenkins-hbase4:34071] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:10:18,135 DEBUG [RS:2;jenkins-hbase4:34071] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34071,1689970216065' 2023-07-21 20:10:18,135 DEBUG [RS:2;jenkins-hbase4:34071] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-21 20:10:18,126 DEBUG [RS:1;jenkins-hbase4:37823] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:10:18,136 DEBUG [RS:1;jenkins-hbase4:37823] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,37823,1689970216018' 2023-07-21 20:10:18,136 DEBUG [RS:1;jenkins-hbase4:37823] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:10:18,136 DEBUG [RS:2;jenkins-hbase4:34071] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-21 20:10:18,137 DEBUG [RS:1;jenkins-hbase4:37823] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:10:18,137 DEBUG [RS:2;jenkins-hbase4:34071] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-21 20:10:18,137 DEBUG [RS:2;jenkins-hbase4:34071] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-21 20:10:18,137 DEBUG [RS:2;jenkins-hbase4:34071] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:10:18,137 DEBUG [RS:2;jenkins-hbase4:34071] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34071,1689970216065' 2023-07-21 20:10:18,137 DEBUG [RS:2;jenkins-hbase4:34071] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:10:18,142 DEBUG [RS:1;jenkins-hbase4:37823] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-21 20:10:18,143 DEBUG [RS:2;jenkins-hbase4:34071] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:10:18,143 INFO [RS:1;jenkins-hbase4:37823] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-21 20:10:18,147 INFO [RS:1;jenkins-hbase4:37823] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-21 20:10:18,147 DEBUG [RS:2;jenkins-hbase4:34071] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-21 20:10:18,147 INFO [RS:2;jenkins-hbase4:34071] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-21 20:10:18,147 INFO [RS:2;jenkins-hbase4:34071] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-21 20:10:18,161 DEBUG [jenkins-hbase4:41777] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-07-21 20:10:18,165 DEBUG [jenkins-hbase4:41777] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-21 20:10:18,172 DEBUG [jenkins-hbase4:41777] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-21 20:10:18,172 DEBUG [jenkins-hbase4:41777] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-21 20:10:18,172 DEBUG [jenkins-hbase4:41777] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-21 20:10:18,172 DEBUG [jenkins-hbase4:41777] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-21 20:10:18,176 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,40099,1689970215928, state=OPENING 2023-07-21 20:10:18,185 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-21 20:10:18,186 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-21 20:10:18,187 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-21 20:10:18,219 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,40099,1689970215928}] 2023-07-21 20:10:18,251 INFO [RS:0;jenkins-hbase4:40099] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40099%2C1689970215928, suffix=, logDir=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/WALs/jenkins-hbase4.apache.org,40099,1689970215928, archiveDir=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/oldWALs, maxLogs=32 2023-07-21 20:10:18,251 INFO [RS:1;jenkins-hbase4:37823] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C37823%2C1689970216018, suffix=, logDir=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/WALs/jenkins-hbase4.apache.org,37823,1689970216018, archiveDir=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/oldWALs, maxLogs=32 2023-07-21 20:10:18,253 INFO [RS:2;jenkins-hbase4:34071] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C34071%2C1689970216065, suffix=, logDir=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/WALs/jenkins-hbase4.apache.org,34071,1689970216065, archiveDir=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/oldWALs, maxLogs=32 2023-07-21 20:10:18,343 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36137,DS-2fdd07fc-7f56-4522-b412-521019925a4c,DISK] 2023-07-21 20:10:18,352 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41597,DS-54bf5ffe-b0eb-4d2e-a59f-48678e76a8af,DISK] 2023-07-21 20:10:18,356 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36137,DS-2fdd07fc-7f56-4522-b412-521019925a4c,DISK] 2023-07-21 20:10:18,356 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41597,DS-54bf5ffe-b0eb-4d2e-a59f-48678e76a8af,DISK] 2023-07-21 20:10:18,356 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46381,DS-7d02c527-3bf4-47eb-b74d-85f81b654290,DISK] 2023-07-21 20:10:18,357 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46381,DS-7d02c527-3bf4-47eb-b74d-85f81b654290,DISK] 2023-07-21 20:10:18,359 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46381,DS-7d02c527-3bf4-47eb-b74d-85f81b654290,DISK] 2023-07-21 20:10:18,359 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36137,DS-2fdd07fc-7f56-4522-b412-521019925a4c,DISK] 2023-07-21 20:10:18,370 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41597,DS-54bf5ffe-b0eb-4d2e-a59f-48678e76a8af,DISK] 2023-07-21 20:10:18,384 INFO [RS:0;jenkins-hbase4:40099] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/WALs/jenkins-hbase4.apache.org,40099,1689970215928/jenkins-hbase4.apache.org%2C40099%2C1689970215928.1689970218262 2023-07-21 20:10:18,384 INFO [RS:1;jenkins-hbase4:37823] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/WALs/jenkins-hbase4.apache.org,37823,1689970216018/jenkins-hbase4.apache.org%2C37823%2C1689970216018.1689970218262 2023-07-21 20:10:18,384 INFO [RS:2;jenkins-hbase4:34071] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/WALs/jenkins-hbase4.apache.org,34071,1689970216065/jenkins-hbase4.apache.org%2C34071%2C1689970216065.1689970218260 2023-07-21 20:10:18,386 DEBUG [RS:0;jenkins-hbase4:40099] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36137,DS-2fdd07fc-7f56-4522-b412-521019925a4c,DISK], DatanodeInfoWithStorage[127.0.0.1:41597,DS-54bf5ffe-b0eb-4d2e-a59f-48678e76a8af,DISK], DatanodeInfoWithStorage[127.0.0.1:46381,DS-7d02c527-3bf4-47eb-b74d-85f81b654290,DISK]] 2023-07-21 20:10:18,390 DEBUG [RS:2;jenkins-hbase4:34071] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46381,DS-7d02c527-3bf4-47eb-b74d-85f81b654290,DISK], DatanodeInfoWithStorage[127.0.0.1:36137,DS-2fdd07fc-7f56-4522-b412-521019925a4c,DISK], DatanodeInfoWithStorage[127.0.0.1:41597,DS-54bf5ffe-b0eb-4d2e-a59f-48678e76a8af,DISK]] 2023-07-21 20:10:18,391 DEBUG [RS:1;jenkins-hbase4:37823] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41597,DS-54bf5ffe-b0eb-4d2e-a59f-48678e76a8af,DISK], DatanodeInfoWithStorage[127.0.0.1:46381,DS-7d02c527-3bf4-47eb-b74d-85f81b654290,DISK], DatanodeInfoWithStorage[127.0.0.1:36137,DS-2fdd07fc-7f56-4522-b412-521019925a4c,DISK]] 2023-07-21 20:10:18,479 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:10:18,481 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-21 20:10:18,489 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36622, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-21 20:10:18,505 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-21 20:10:18,505 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-21 20:10:18,510 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40099%2C1689970215928.meta, suffix=.meta, logDir=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/WALs/jenkins-hbase4.apache.org,40099,1689970215928, archiveDir=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/oldWALs, maxLogs=32 2023-07-21 20:10:18,554 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36137,DS-2fdd07fc-7f56-4522-b412-521019925a4c,DISK] 2023-07-21 20:10:18,556 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41597,DS-54bf5ffe-b0eb-4d2e-a59f-48678e76a8af,DISK] 2023-07-21 20:10:18,560 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46381,DS-7d02c527-3bf4-47eb-b74d-85f81b654290,DISK] 2023-07-21 20:10:18,598 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/WALs/jenkins-hbase4.apache.org,40099,1689970215928/jenkins-hbase4.apache.org%2C40099%2C1689970215928.meta.1689970218512.meta 2023-07-21 20:10:18,600 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36137,DS-2fdd07fc-7f56-4522-b412-521019925a4c,DISK], DatanodeInfoWithStorage[127.0.0.1:41597,DS-54bf5ffe-b0eb-4d2e-a59f-48678e76a8af,DISK], DatanodeInfoWithStorage[127.0.0.1:46381,DS-7d02c527-3bf4-47eb-b74d-85f81b654290,DISK]] 2023-07-21 20:10:18,600 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-21 20:10:18,602 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-07-21 20:10:18,603 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 20:10:18,605 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-21 20:10:18,608 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-21 20:10:18,610 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-21 20:10:18,641 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-21 20:10:18,641 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 20:10:18,641 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-21 20:10:18,641 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-21 20:10:18,651 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-21 20:10:18,658 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/hbase/meta/1588230740/info 2023-07-21 20:10:18,659 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/hbase/meta/1588230740/info 2023-07-21 20:10:18,660 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-21 20:10:18,664 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 20:10:18,664 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-21 20:10:18,667 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/hbase/meta/1588230740/rep_barrier 2023-07-21 20:10:18,667 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/hbase/meta/1588230740/rep_barrier 2023-07-21 20:10:18,668 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-21 20:10:18,669 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 20:10:18,669 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-21 20:10:18,672 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/hbase/meta/1588230740/table 2023-07-21 20:10:18,672 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/hbase/meta/1588230740/table 2023-07-21 20:10:18,675 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-21 20:10:18,677 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 20:10:18,680 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/hbase/meta/1588230740 2023-07-21 20:10:18,687 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/hbase/meta/1588230740 2023-07-21 20:10:18,692 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-21 20:10:18,696 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-21 20:10:18,702 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72823144, jitterRate=0.08514940738677979}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-21 20:10:18,708 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-21 20:10:18,726 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1689970218466 2023-07-21 20:10:18,758 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-21 20:10:18,759 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-21 20:10:18,761 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,40099,1689970215928, state=OPEN 2023-07-21 20:10:18,765 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-21 20:10:18,765 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-21 20:10:18,771 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-21 20:10:18,771 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,40099,1689970215928 in 546 msec 2023-07-21 20:10:18,779 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-21 20:10:18,780 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 799 msec 2023-07-21 20:10:18,787 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.2150 sec 2023-07-21 20:10:18,787 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1689970218787, completionTime=-1 2023-07-21 20:10:18,787 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-07-21 20:10:18,787 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-21 20:10:18,892 DEBUG [hconnection-0x3e3f9760-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 20:10:18,898 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36626, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 20:10:18,927 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-07-21 20:10:18,927 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689970278927 2023-07-21 20:10:18,927 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689970338927 2023-07-21 20:10:18,927 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 139 msec 2023-07-21 20:10:18,969 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41777,1689970214362-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-21 20:10:18,969 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41777,1689970214362-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-21 20:10:18,970 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41777,1689970214362-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-21 20:10:18,974 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:41777, period=300000, unit=MILLISECONDS is enabled. 2023-07-21 20:10:18,974 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-21 20:10:18,997 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-21 20:10:18,997 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-21 20:10:18,999 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-21 20:10:19,012 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-21 20:10:19,015 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-21 20:10:19,019 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-21 20:10:19,041 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/hbase/namespace/3c6f124cc5357f8acdaf270484dac43a 2023-07-21 20:10:19,044 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/hbase/namespace/3c6f124cc5357f8acdaf270484dac43a empty. 2023-07-21 20:10:19,045 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/hbase/namespace/3c6f124cc5357f8acdaf270484dac43a 2023-07-21 20:10:19,045 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-21 20:10:19,093 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-21 20:10:19,096 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 3c6f124cc5357f8acdaf270484dac43a, NAME => 'hbase:namespace,,1689970218998.3c6f124cc5357f8acdaf270484dac43a.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp 2023-07-21 20:10:19,114 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689970218998.3c6f124cc5357f8acdaf270484dac43a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 20:10:19,114 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 3c6f124cc5357f8acdaf270484dac43a, disabling compactions & flushes 2023-07-21 20:10:19,114 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689970218998.3c6f124cc5357f8acdaf270484dac43a. 2023-07-21 20:10:19,114 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689970218998.3c6f124cc5357f8acdaf270484dac43a. 2023-07-21 20:10:19,114 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689970218998.3c6f124cc5357f8acdaf270484dac43a. after waiting 0 ms 2023-07-21 20:10:19,114 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689970218998.3c6f124cc5357f8acdaf270484dac43a. 2023-07-21 20:10:19,114 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689970218998.3c6f124cc5357f8acdaf270484dac43a. 2023-07-21 20:10:19,115 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 3c6f124cc5357f8acdaf270484dac43a: 2023-07-21 20:10:19,119 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-21 20:10:19,135 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1689970218998.3c6f124cc5357f8acdaf270484dac43a.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689970219122"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689970219122"}]},"ts":"1689970219122"} 2023-07-21 20:10:19,167 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-21 20:10:19,169 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-21 20:10:19,173 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689970219169"}]},"ts":"1689970219169"} 2023-07-21 20:10:19,180 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-21 20:10:19,186 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-21 20:10:19,188 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-21 20:10:19,188 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-21 20:10:19,188 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-21 20:10:19,188 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-21 20:10:19,191 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=3c6f124cc5357f8acdaf270484dac43a, ASSIGN}] 2023-07-21 20:10:19,194 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=3c6f124cc5357f8acdaf270484dac43a, ASSIGN 2023-07-21 20:10:19,205 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=3c6f124cc5357f8acdaf270484dac43a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34071,1689970216065; forceNewPlan=false, retain=false 2023-07-21 20:10:19,358 INFO [jenkins-hbase4:41777] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-21 20:10:19,359 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=3c6f124cc5357f8acdaf270484dac43a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:10:19,360 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1689970218998.3c6f124cc5357f8acdaf270484dac43a.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689970219359"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689970219359"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689970219359"}]},"ts":"1689970219359"} 2023-07-21 20:10:19,366 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 3c6f124cc5357f8acdaf270484dac43a, server=jenkins-hbase4.apache.org,34071,1689970216065}] 2023-07-21 20:10:19,520 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:10:19,521 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-21 20:10:19,524 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55184, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-21 20:10:19,531 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1689970218998.3c6f124cc5357f8acdaf270484dac43a. 2023-07-21 20:10:19,531 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 3c6f124cc5357f8acdaf270484dac43a, NAME => 'hbase:namespace,,1689970218998.3c6f124cc5357f8acdaf270484dac43a.', STARTKEY => '', ENDKEY => ''} 2023-07-21 20:10:19,531 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1689970218998.3c6f124cc5357f8acdaf270484dac43a. service=AccessControlService 2023-07-21 20:10:19,532 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 20:10:19,532 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 3c6f124cc5357f8acdaf270484dac43a 2023-07-21 20:10:19,533 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689970218998.3c6f124cc5357f8acdaf270484dac43a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 20:10:19,533 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 3c6f124cc5357f8acdaf270484dac43a 2023-07-21 20:10:19,533 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 3c6f124cc5357f8acdaf270484dac43a 2023-07-21 20:10:19,536 INFO [StoreOpener-3c6f124cc5357f8acdaf270484dac43a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 3c6f124cc5357f8acdaf270484dac43a 2023-07-21 20:10:19,538 DEBUG [StoreOpener-3c6f124cc5357f8acdaf270484dac43a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/hbase/namespace/3c6f124cc5357f8acdaf270484dac43a/info 2023-07-21 20:10:19,538 DEBUG [StoreOpener-3c6f124cc5357f8acdaf270484dac43a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/hbase/namespace/3c6f124cc5357f8acdaf270484dac43a/info 2023-07-21 20:10:19,539 INFO [StoreOpener-3c6f124cc5357f8acdaf270484dac43a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3c6f124cc5357f8acdaf270484dac43a columnFamilyName info 2023-07-21 20:10:19,540 INFO [StoreOpener-3c6f124cc5357f8acdaf270484dac43a-1] regionserver.HStore(310): Store=3c6f124cc5357f8acdaf270484dac43a/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 20:10:19,541 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/hbase/namespace/3c6f124cc5357f8acdaf270484dac43a 2023-07-21 20:10:19,543 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/hbase/namespace/3c6f124cc5357f8acdaf270484dac43a 2023-07-21 20:10:19,548 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 3c6f124cc5357f8acdaf270484dac43a 2023-07-21 20:10:19,551 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/hbase/namespace/3c6f124cc5357f8acdaf270484dac43a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-21 20:10:19,552 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 3c6f124cc5357f8acdaf270484dac43a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63896392, jitterRate=-0.04786956310272217}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-21 20:10:19,552 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 3c6f124cc5357f8acdaf270484dac43a: 2023-07-21 20:10:19,554 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1689970218998.3c6f124cc5357f8acdaf270484dac43a., pid=6, masterSystemTime=1689970219520 2023-07-21 20:10:19,558 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1689970218998.3c6f124cc5357f8acdaf270484dac43a. 2023-07-21 20:10:19,559 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1689970218998.3c6f124cc5357f8acdaf270484dac43a. 2023-07-21 20:10:19,560 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=3c6f124cc5357f8acdaf270484dac43a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:10:19,560 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1689970218998.3c6f124cc5357f8acdaf270484dac43a.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689970219560"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689970219560"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689970219560"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689970219560"}]},"ts":"1689970219560"} 2023-07-21 20:10:19,567 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-21 20:10:19,568 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 3c6f124cc5357f8acdaf270484dac43a, server=jenkins-hbase4.apache.org,34071,1689970216065 in 197 msec 2023-07-21 20:10:19,571 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-21 20:10:19,572 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=3c6f124cc5357f8acdaf270484dac43a, ASSIGN in 376 msec 2023-07-21 20:10:19,573 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-21 20:10:19,573 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689970219573"}]},"ts":"1689970219573"} 2023-07-21 20:10:19,575 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-21 20:10:19,578 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-21 20:10:19,581 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 578 msec 2023-07-21 20:10:19,616 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-21 20:10:19,618 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-21 20:10:19,618 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-21 20:10:19,639 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 20:10:19,641 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55196, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 20:10:19,653 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-21 20:10:19,668 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-21 20:10:19,674 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 28 msec 2023-07-21 20:10:19,686 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-21 20:10:19,699 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-21 20:10:19,715 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 26 msec 2023-07-21 20:10:19,723 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-21 20:10:19,726 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-21 20:10:19,726 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.575sec 2023-07-21 20:10:19,730 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-21 20:10:19,732 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-21 20:10:19,732 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-21 20:10:19,733 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41777,1689970214362-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-21 20:10:19,734 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41777,1689970214362-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-21 20:10:19,762 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-21 20:10:19,764 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-07-21 20:10:19,766 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-07-21 20:10:19,768 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-21 20:10:19,770 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-07-21 20:10:19,770 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/hbase/acl/1b3082bcd4e87c68447f85e5143e2878 2023-07-21 20:10:19,772 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/hbase/acl/1b3082bcd4e87c68447f85e5143e2878 empty. 2023-07-21 20:10:19,774 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/hbase/acl/1b3082bcd4e87c68447f85e5143e2878 2023-07-21 20:10:19,774 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-07-21 20:10:19,779 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-21 20:10:19,805 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-07-21 20:10:19,808 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => 1b3082bcd4e87c68447f85e5143e2878, NAME => 'hbase:acl,,1689970219757.1b3082bcd4e87c68447f85e5143e2878.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp 2023-07-21 20:10:19,834 DEBUG [Listener at localhost/33825] zookeeper.ReadOnlyZKClient(139): Connect 0x783bbc0f to 127.0.0.1:59101 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 20:10:19,848 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689970219757.1b3082bcd4e87c68447f85e5143e2878.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 20:10:19,848 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing 1b3082bcd4e87c68447f85e5143e2878, disabling compactions & flushes 2023-07-21 20:10:19,848 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689970219757.1b3082bcd4e87c68447f85e5143e2878. 2023-07-21 20:10:19,848 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689970219757.1b3082bcd4e87c68447f85e5143e2878. 2023-07-21 20:10:19,848 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689970219757.1b3082bcd4e87c68447f85e5143e2878. after waiting 0 ms 2023-07-21 20:10:19,848 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689970219757.1b3082bcd4e87c68447f85e5143e2878. 2023-07-21 20:10:19,848 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1689970219757.1b3082bcd4e87c68447f85e5143e2878. 2023-07-21 20:10:19,848 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for 1b3082bcd4e87c68447f85e5143e2878: 2023-07-21 20:10:19,849 DEBUG [Listener at localhost/33825] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@193df40, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 20:10:19,855 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-07-21 20:10:19,858 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1689970219757.1b3082bcd4e87c68447f85e5143e2878.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689970219858"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689970219858"}]},"ts":"1689970219858"} 2023-07-21 20:10:19,861 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-21 20:10:19,862 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-21 20:10:19,863 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689970219862"}]},"ts":"1689970219862"} 2023-07-21 20:10:19,865 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-07-21 20:10:19,874 DEBUG [hconnection-0x5dbe67be-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 20:10:19,874 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-21 20:10:19,875 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-21 20:10:19,875 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-21 20:10:19,875 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-21 20:10:19,875 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-21 20:10:19,875 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=1b3082bcd4e87c68447f85e5143e2878, ASSIGN}] 2023-07-21 20:10:19,878 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=1b3082bcd4e87c68447f85e5143e2878, ASSIGN 2023-07-21 20:10:19,880 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=1b3082bcd4e87c68447f85e5143e2878, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37823,1689970216018; forceNewPlan=false, retain=false 2023-07-21 20:10:19,884 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-21 20:10:19,891 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36636, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 20:10:19,894 INFO [Listener at localhost/33825] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,41777,1689970214362 2023-07-21 20:10:19,895 INFO [Listener at localhost/33825] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-07-21 20:10:19,895 INFO [Listener at localhost/33825] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c4475fbf-6a12-c189-d7a2-889953ef4b74/test.cache.data in system properties and HBase conf 2023-07-21 20:10:19,895 INFO [Listener at localhost/33825] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c4475fbf-6a12-c189-d7a2-889953ef4b74/hadoop.tmp.dir in system properties and HBase conf 2023-07-21 20:10:19,895 INFO [Listener at localhost/33825] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c4475fbf-6a12-c189-d7a2-889953ef4b74/hadoop.log.dir in system properties and HBase conf 2023-07-21 20:10:19,895 INFO [Listener at localhost/33825] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c4475fbf-6a12-c189-d7a2-889953ef4b74/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-21 20:10:19,895 INFO [Listener at localhost/33825] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c4475fbf-6a12-c189-d7a2-889953ef4b74/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-21 20:10:19,895 INFO [Listener at localhost/33825] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-21 20:10:19,895 INFO [Listener at localhost/33825] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c4475fbf-6a12-c189-d7a2-889953ef4b74/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-21 20:10:19,895 INFO [Listener at localhost/33825] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c4475fbf-6a12-c189-d7a2-889953ef4b74/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-21 20:10:19,896 INFO [Listener at localhost/33825] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c4475fbf-6a12-c189-d7a2-889953ef4b74/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-21 20:10:19,896 INFO [Listener at localhost/33825] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c4475fbf-6a12-c189-d7a2-889953ef4b74/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-21 20:10:19,896 INFO [Listener at localhost/33825] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c4475fbf-6a12-c189-d7a2-889953ef4b74/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-21 20:10:19,896 INFO [Listener at localhost/33825] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c4475fbf-6a12-c189-d7a2-889953ef4b74/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-21 20:10:19,896 INFO [Listener at localhost/33825] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c4475fbf-6a12-c189-d7a2-889953ef4b74/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-21 20:10:19,896 INFO [Listener at localhost/33825] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c4475fbf-6a12-c189-d7a2-889953ef4b74/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-21 20:10:19,896 INFO [Listener at localhost/33825] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c4475fbf-6a12-c189-d7a2-889953ef4b74/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-21 20:10:19,896 INFO [Listener at localhost/33825] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c4475fbf-6a12-c189-d7a2-889953ef4b74/nfs.dump.dir in system properties and HBase conf 2023-07-21 20:10:19,897 INFO [Listener at localhost/33825] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c4475fbf-6a12-c189-d7a2-889953ef4b74/java.io.tmpdir in system properties and HBase conf 2023-07-21 20:10:19,897 INFO [Listener at localhost/33825] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c4475fbf-6a12-c189-d7a2-889953ef4b74/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-21 20:10:19,897 INFO [Listener at localhost/33825] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c4475fbf-6a12-c189-d7a2-889953ef4b74/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-21 20:10:19,897 INFO [Listener at localhost/33825] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c4475fbf-6a12-c189-d7a2-889953ef4b74/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-07-21 20:10:20,030 INFO [jenkins-hbase4:41777] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-21 20:10:20,032 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=1b3082bcd4e87c68447f85e5143e2878, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:10:20,032 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1689970219757.1b3082bcd4e87c68447f85e5143e2878.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689970220031"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689970220031"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689970220031"}]},"ts":"1689970220031"} 2023-07-21 20:10:20,037 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 1b3082bcd4e87c68447f85e5143e2878, server=jenkins-hbase4.apache.org,37823,1689970216018}] 2023-07-21 20:10:20,085 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-21 20:10:20,194 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:10:20,195 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-21 20:10:20,254 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44316, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-21 20:10:20,277 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1689970219757.1b3082bcd4e87c68447f85e5143e2878. 2023-07-21 20:10:20,279 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1b3082bcd4e87c68447f85e5143e2878, NAME => 'hbase:acl,,1689970219757.1b3082bcd4e87c68447f85e5143e2878.', STARTKEY => '', ENDKEY => ''} 2023-07-21 20:10:20,279 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1689970219757.1b3082bcd4e87c68447f85e5143e2878. service=AccessControlService 2023-07-21 20:10:20,279 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 20:10:20,280 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl 1b3082bcd4e87c68447f85e5143e2878 2023-07-21 20:10:20,280 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689970219757.1b3082bcd4e87c68447f85e5143e2878.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 20:10:20,280 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1b3082bcd4e87c68447f85e5143e2878 2023-07-21 20:10:20,280 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1b3082bcd4e87c68447f85e5143e2878 2023-07-21 20:10:20,282 INFO [StoreOpener-1b3082bcd4e87c68447f85e5143e2878-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region 1b3082bcd4e87c68447f85e5143e2878 2023-07-21 20:10:20,290 DEBUG [StoreOpener-1b3082bcd4e87c68447f85e5143e2878-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/hbase/acl/1b3082bcd4e87c68447f85e5143e2878/l 2023-07-21 20:10:20,291 DEBUG [StoreOpener-1b3082bcd4e87c68447f85e5143e2878-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/hbase/acl/1b3082bcd4e87c68447f85e5143e2878/l 2023-07-21 20:10:20,291 INFO [StoreOpener-1b3082bcd4e87c68447f85e5143e2878-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1b3082bcd4e87c68447f85e5143e2878 columnFamilyName l 2023-07-21 20:10:20,295 INFO [StoreOpener-1b3082bcd4e87c68447f85e5143e2878-1] regionserver.HStore(310): Store=1b3082bcd4e87c68447f85e5143e2878/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 20:10:20,301 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/hbase/acl/1b3082bcd4e87c68447f85e5143e2878 2023-07-21 20:10:20,304 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/hbase/acl/1b3082bcd4e87c68447f85e5143e2878 2023-07-21 20:10:20,309 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1b3082bcd4e87c68447f85e5143e2878 2023-07-21 20:10:20,320 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/hbase/acl/1b3082bcd4e87c68447f85e5143e2878/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-21 20:10:20,322 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1b3082bcd4e87c68447f85e5143e2878; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73577437, jitterRate=0.09638924896717072}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-21 20:10:20,322 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1b3082bcd4e87c68447f85e5143e2878: 2023-07-21 20:10:20,330 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1689970219757.1b3082bcd4e87c68447f85e5143e2878., pid=11, masterSystemTime=1689970220194 2023-07-21 20:10:20,345 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1689970219757.1b3082bcd4e87c68447f85e5143e2878. 2023-07-21 20:10:20,346 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=1b3082bcd4e87c68447f85e5143e2878, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:10:20,346 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1689970219757.1b3082bcd4e87c68447f85e5143e2878.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689970220345"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689970220345"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689970220345"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689970220345"}]},"ts":"1689970220345"} 2023-07-21 20:10:20,348 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1689970219757.1b3082bcd4e87c68447f85e5143e2878. 2023-07-21 20:10:20,361 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-07-21 20:10:20,361 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 1b3082bcd4e87c68447f85e5143e2878, server=jenkins-hbase4.apache.org,37823,1689970216018 in 318 msec 2023-07-21 20:10:20,366 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-07-21 20:10:20,366 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=1b3082bcd4e87c68447f85e5143e2878, ASSIGN in 486 msec 2023-07-21 20:10:20,368 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-21 20:10:20,368 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689970220368"}]},"ts":"1689970220368"} 2023-07-21 20:10:20,371 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-07-21 20:10:20,376 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-07-21 20:10:20,379 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 614 msec 2023-07-21 20:10:20,385 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-21 20:10:20,385 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-07-21 20:10:20,402 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-21 20:10:21,480 WARN [Thread-383] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-21 20:10:21,865 INFO [Thread-383] log.Slf4jLog(67): jetty-6.1.26 2023-07-21 20:10:21,872 INFO [Thread-383] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c4475fbf-6a12-c189-d7a2-889953ef4b74/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_34693_jobhistory____.7jts20/webapp 2023-07-21 20:10:22,065 INFO [Thread-383] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-07-21 20:10:22,065 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-07-21 20:10:22,065 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-21 20:10:22,068 INFO [Thread-383] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-21 20:10:22,162 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-21 20:10:22,503 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-21 20:10:23,015 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-07-21 20:10:23,099 INFO [Thread-383] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:34693 2023-07-21 20:10:24,206 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-21 20:10:24,466 WARN [Listener at jenkins-hbase4.apache.org/45071] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-21 20:10:24,507 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-07-21 20:10:24,509 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-21 20:10:24,510 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-21 20:10:24,550 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 20:10:24,551 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-07-21 20:10:24,551 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 20:10:24,552 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-07-21 20:10:24,552 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-21 20:10:24,552 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-07-21 20:10:24,552 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 20:10:24,552 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-07-21 20:10:24,552 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-21 20:10:24,552 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-21 20:10:24,605 WARN [Listener at jenkins-hbase4.apache.org/45071] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-21 20:10:24,605 INFO [Listener at jenkins-hbase4.apache.org/45071] log.Slf4jLog(67): jetty-6.1.26 2023-07-21 20:10:24,628 INFO [Listener at jenkins-hbase4.apache.org/45071] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c4475fbf-6a12-c189-d7a2-889953ef4b74/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_46007_cluster____.aojqi9/webapp 2023-07-21 20:10:24,725 INFO [Listener at jenkins-hbase4.apache.org/45071] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-07-21 20:10:24,725 INFO [Listener at jenkins-hbase4.apache.org/45071] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-07-21 20:10:24,725 INFO [Listener at jenkins-hbase4.apache.org/45071] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-21 20:10:24,726 INFO [Listener at jenkins-hbase4.apache.org/45071] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-21 20:10:24,736 INFO [Listener at jenkins-hbase4.apache.org/45071] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-21 20:10:24,969 INFO [Listener at jenkins-hbase4.apache.org/45071] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-21 20:10:25,091 INFO [Listener at jenkins-hbase4.apache.org/45071] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-21 20:10:25,100 INFO [Listener at jenkins-hbase4.apache.org/45071] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:46007 2023-07-21 20:10:25,665 WARN [Listener at jenkins-hbase4.apache.org/37361] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-21 20:10:25,693 WARN [Listener at jenkins-hbase4.apache.org/37361] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-21 20:10:25,694 INFO [Listener at jenkins-hbase4.apache.org/37361] log.Slf4jLog(67): jetty-6.1.26 2023-07-21 20:10:25,705 INFO [Listener at jenkins-hbase4.apache.org/37361] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c4475fbf-6a12-c189-d7a2-889953ef4b74/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_36641_node____.emrdg2/webapp 2023-07-21 20:10:25,773 INFO [Listener at jenkins-hbase4.apache.org/37361] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-21 20:10:25,773 INFO [Listener at jenkins-hbase4.apache.org/37361] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-21 20:10:25,773 INFO [Listener at jenkins-hbase4.apache.org/37361] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-21 20:10:25,774 INFO [Listener at jenkins-hbase4.apache.org/37361] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-21 20:10:25,784 INFO [Listener at jenkins-hbase4.apache.org/37361] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-21 20:10:25,805 INFO [Listener at jenkins-hbase4.apache.org/37361] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-21 20:10:25,876 INFO [Listener at jenkins-hbase4.apache.org/37361] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-21 20:10:25,889 INFO [Listener at jenkins-hbase4.apache.org/37361] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:36641 2023-07-21 20:10:26,174 WARN [Listener at jenkins-hbase4.apache.org/38105] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-21 20:10:26,181 WARN [Listener at jenkins-hbase4.apache.org/38105] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-21 20:10:26,181 INFO [Listener at jenkins-hbase4.apache.org/38105] log.Slf4jLog(67): jetty-6.1.26 2023-07-21 20:10:26,193 INFO [Listener at jenkins-hbase4.apache.org/38105] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c4475fbf-6a12-c189-d7a2-889953ef4b74/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_41639_node____i2ujel/webapp 2023-07-21 20:10:26,273 INFO [Listener at jenkins-hbase4.apache.org/38105] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-21 20:10:26,273 INFO [Listener at jenkins-hbase4.apache.org/38105] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-21 20:10:26,273 INFO [Listener at jenkins-hbase4.apache.org/38105] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-21 20:10:26,273 INFO [Listener at jenkins-hbase4.apache.org/38105] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-21 20:10:26,283 INFO [Listener at jenkins-hbase4.apache.org/38105] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-21 20:10:26,303 INFO [Listener at jenkins-hbase4.apache.org/38105] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-21 20:10:26,390 INFO [Listener at jenkins-hbase4.apache.org/38105] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-21 20:10:26,396 INFO [Listener at jenkins-hbase4.apache.org/38105] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:41639 2023-07-21 20:10:26,438 INFO [Listener at jenkins-hbase4.apache.org/38105] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-07-21 20:10:26,440 INFO [Listener at jenkins-hbase4.apache.org/38105] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-07-21 20:10:26,515 INFO [Listener at jenkins-hbase4.apache.org/38105] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=706, OpenFileDescriptor=898, MaxFileDescriptor=60000, SystemLoadAverage=304, ProcessCount=179, AvailableMemoryMB=9361 2023-07-21 20:10:26,515 WARN [Listener at jenkins-hbase4.apache.org/38105] hbase.ResourceChecker(130): Thread=706 is superior to 500 2023-07-21 20:10:26,530 DEBUG [Listener at jenkins-hbase4.apache.org/38105] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-21 20:10:26,537 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40424, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-21 20:10:26,544 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-21 20:10:26,547 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-07-21 20:10:26,550 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-07-21 20:10:26,553 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-07-21 20:10:26,554 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-21 20:10:26,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-21 20:10:26,558 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testExportWithTargetName/85b0b0c0e18b94d85855e4e449e09302 2023-07-21 20:10:26,558 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testExportWithTargetName/f19224918f8f0414d2b7a4e76c5347d7 2023-07-21 20:10:26,561 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testExportWithTargetName/85b0b0c0e18b94d85855e4e449e09302 empty. 2023-07-21 20:10:26,561 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testExportWithTargetName/f19224918f8f0414d2b7a4e76c5347d7 empty. 2023-07-21 20:10:26,564 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testExportWithTargetName/f19224918f8f0414d2b7a4e76c5347d7 2023-07-21 20:10:26,564 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testExportWithTargetName/85b0b0c0e18b94d85855e4e449e09302 2023-07-21 20:10:26,565 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-21 20:10:26,604 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-07-21 20:10:26,606 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => 85b0b0c0e18b94d85855e4e449e09302, NAME => 'testtb-testExportWithTargetName,,1689970226544.85b0b0c0e18b94d85855e4e449e09302.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp 2023-07-21 20:10:26,607 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => f19224918f8f0414d2b7a4e76c5347d7, NAME => 'testtb-testExportWithTargetName,1,1689970226544.f19224918f8f0414d2b7a4e76c5347d7.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp 2023-07-21 20:10:26,644 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689970226544.85b0b0c0e18b94d85855e4e449e09302.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 20:10:26,645 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing 85b0b0c0e18b94d85855e4e449e09302, disabling compactions & flushes 2023-07-21 20:10:26,645 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689970226544.85b0b0c0e18b94d85855e4e449e09302. 2023-07-21 20:10:26,645 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689970226544.85b0b0c0e18b94d85855e4e449e09302. 2023-07-21 20:10:26,645 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689970226544.85b0b0c0e18b94d85855e4e449e09302. after waiting 0 ms 2023-07-21 20:10:26,645 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689970226544.85b0b0c0e18b94d85855e4e449e09302. 2023-07-21 20:10:26,645 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689970226544.85b0b0c0e18b94d85855e4e449e09302. 2023-07-21 20:10:26,645 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for 85b0b0c0e18b94d85855e4e449e09302: 2023-07-21 20:10:26,646 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689970226544.f19224918f8f0414d2b7a4e76c5347d7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 20:10:26,647 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing f19224918f8f0414d2b7a4e76c5347d7, disabling compactions & flushes 2023-07-21 20:10:26,647 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689970226544.f19224918f8f0414d2b7a4e76c5347d7. 2023-07-21 20:10:26,647 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689970226544.f19224918f8f0414d2b7a4e76c5347d7. 2023-07-21 20:10:26,647 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689970226544.f19224918f8f0414d2b7a4e76c5347d7. after waiting 0 ms 2023-07-21 20:10:26,647 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689970226544.f19224918f8f0414d2b7a4e76c5347d7. 2023-07-21 20:10:26,647 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689970226544.f19224918f8f0414d2b7a4e76c5347d7. 2023-07-21 20:10:26,647 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for f19224918f8f0414d2b7a4e76c5347d7: 2023-07-21 20:10:26,651 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-07-21 20:10:26,652 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689970226544.85b0b0c0e18b94d85855e4e449e09302.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689970226652"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689970226652"}]},"ts":"1689970226652"} 2023-07-21 20:10:26,653 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689970226544.f19224918f8f0414d2b7a4e76c5347d7.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689970226652"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689970226652"}]},"ts":"1689970226652"} 2023-07-21 20:10:26,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-21 20:10:26,709 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-21 20:10:26,711 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-21 20:10:26,711 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689970226711"}]},"ts":"1689970226711"} 2023-07-21 20:10:26,714 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-07-21 20:10:26,721 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-21 20:10:26,723 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-21 20:10:26,723 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-21 20:10:26,723 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-21 20:10:26,724 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-21 20:10:26,724 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=85b0b0c0e18b94d85855e4e449e09302, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=f19224918f8f0414d2b7a4e76c5347d7, ASSIGN}] 2023-07-21 20:10:26,730 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=85b0b0c0e18b94d85855e4e449e09302, ASSIGN 2023-07-21 20:10:26,730 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=f19224918f8f0414d2b7a4e76c5347d7, ASSIGN 2023-07-21 20:10:26,732 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=85b0b0c0e18b94d85855e4e449e09302, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37823,1689970216018; forceNewPlan=false, retain=false 2023-07-21 20:10:26,735 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=f19224918f8f0414d2b7a4e76c5347d7, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40099,1689970215928; forceNewPlan=false, retain=false 2023-07-21 20:10:26,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-21 20:10:26,882 INFO [jenkins-hbase4:41777] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-21 20:10:26,885 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=f19224918f8f0414d2b7a4e76c5347d7, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:10:26,885 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=85b0b0c0e18b94d85855e4e449e09302, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:10:26,885 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689970226544.f19224918f8f0414d2b7a4e76c5347d7.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689970226885"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689970226885"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689970226885"}]},"ts":"1689970226885"} 2023-07-21 20:10:26,885 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689970226544.85b0b0c0e18b94d85855e4e449e09302.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689970226885"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689970226885"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689970226885"}]},"ts":"1689970226885"} 2023-07-21 20:10:26,891 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE; OpenRegionProcedure f19224918f8f0414d2b7a4e76c5347d7, server=jenkins-hbase4.apache.org,40099,1689970215928}] 2023-07-21 20:10:26,893 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=13, state=RUNNABLE; OpenRegionProcedure 85b0b0c0e18b94d85855e4e449e09302, server=jenkins-hbase4.apache.org,37823,1689970216018}] 2023-07-21 20:10:27,051 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1689970226544.f19224918f8f0414d2b7a4e76c5347d7. 2023-07-21 20:10:27,051 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f19224918f8f0414d2b7a4e76c5347d7, NAME => 'testtb-testExportWithTargetName,1,1689970226544.f19224918f8f0414d2b7a4e76c5347d7.', STARTKEY => '1', ENDKEY => ''} 2023-07-21 20:10:27,052 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1689970226544.f19224918f8f0414d2b7a4e76c5347d7. service=AccessControlService 2023-07-21 20:10:27,052 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 20:10:27,052 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName f19224918f8f0414d2b7a4e76c5347d7 2023-07-21 20:10:27,052 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689970226544.f19224918f8f0414d2b7a4e76c5347d7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 20:10:27,053 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f19224918f8f0414d2b7a4e76c5347d7 2023-07-21 20:10:27,053 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f19224918f8f0414d2b7a4e76c5347d7 2023-07-21 20:10:27,057 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1689970226544.85b0b0c0e18b94d85855e4e449e09302. 2023-07-21 20:10:27,057 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 85b0b0c0e18b94d85855e4e449e09302, NAME => 'testtb-testExportWithTargetName,,1689970226544.85b0b0c0e18b94d85855e4e449e09302.', STARTKEY => '', ENDKEY => '1'} 2023-07-21 20:10:27,057 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1689970226544.85b0b0c0e18b94d85855e4e449e09302. service=AccessControlService 2023-07-21 20:10:27,057 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 20:10:27,058 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 85b0b0c0e18b94d85855e4e449e09302 2023-07-21 20:10:27,058 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689970226544.85b0b0c0e18b94d85855e4e449e09302.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 20:10:27,058 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 85b0b0c0e18b94d85855e4e449e09302 2023-07-21 20:10:27,058 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 85b0b0c0e18b94d85855e4e449e09302 2023-07-21 20:10:27,064 INFO [StoreOpener-85b0b0c0e18b94d85855e4e449e09302-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 85b0b0c0e18b94d85855e4e449e09302 2023-07-21 20:10:27,065 INFO [StoreOpener-f19224918f8f0414d2b7a4e76c5347d7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region f19224918f8f0414d2b7a4e76c5347d7 2023-07-21 20:10:27,067 DEBUG [StoreOpener-85b0b0c0e18b94d85855e4e449e09302-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testExportWithTargetName/85b0b0c0e18b94d85855e4e449e09302/cf 2023-07-21 20:10:27,067 DEBUG [StoreOpener-85b0b0c0e18b94d85855e4e449e09302-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testExportWithTargetName/85b0b0c0e18b94d85855e4e449e09302/cf 2023-07-21 20:10:27,067 DEBUG [StoreOpener-f19224918f8f0414d2b7a4e76c5347d7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testExportWithTargetName/f19224918f8f0414d2b7a4e76c5347d7/cf 2023-07-21 20:10:27,067 DEBUG [StoreOpener-f19224918f8f0414d2b7a4e76c5347d7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testExportWithTargetName/f19224918f8f0414d2b7a4e76c5347d7/cf 2023-07-21 20:10:27,071 INFO [StoreOpener-f19224918f8f0414d2b7a4e76c5347d7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f19224918f8f0414d2b7a4e76c5347d7 columnFamilyName cf 2023-07-21 20:10:27,071 INFO [StoreOpener-85b0b0c0e18b94d85855e4e449e09302-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 85b0b0c0e18b94d85855e4e449e09302 columnFamilyName cf 2023-07-21 20:10:27,075 INFO [StoreOpener-f19224918f8f0414d2b7a4e76c5347d7-1] regionserver.HStore(310): Store=f19224918f8f0414d2b7a4e76c5347d7/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 20:10:27,077 INFO [StoreOpener-85b0b0c0e18b94d85855e4e449e09302-1] regionserver.HStore(310): Store=85b0b0c0e18b94d85855e4e449e09302/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 20:10:27,080 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testExportWithTargetName/f19224918f8f0414d2b7a4e76c5347d7 2023-07-21 20:10:27,081 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testExportWithTargetName/f19224918f8f0414d2b7a4e76c5347d7 2023-07-21 20:10:27,082 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testExportWithTargetName/85b0b0c0e18b94d85855e4e449e09302 2023-07-21 20:10:27,083 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testExportWithTargetName/85b0b0c0e18b94d85855e4e449e09302 2023-07-21 20:10:27,089 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 85b0b0c0e18b94d85855e4e449e09302 2023-07-21 20:10:27,093 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f19224918f8f0414d2b7a4e76c5347d7 2023-07-21 20:10:27,099 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testExportWithTargetName/85b0b0c0e18b94d85855e4e449e09302/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-21 20:10:27,100 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 85b0b0c0e18b94d85855e4e449e09302; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58867731, jitterRate=-0.12280245125293732}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-21 20:10:27,100 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 85b0b0c0e18b94d85855e4e449e09302: 2023-07-21 20:10:27,104 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testExportWithTargetName/f19224918f8f0414d2b7a4e76c5347d7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-21 20:10:27,104 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1689970226544.85b0b0c0e18b94d85855e4e449e09302., pid=16, masterSystemTime=1689970227047 2023-07-21 20:10:27,105 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f19224918f8f0414d2b7a4e76c5347d7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62924661, jitterRate=-0.062349483370780945}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-21 20:10:27,105 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f19224918f8f0414d2b7a4e76c5347d7: 2023-07-21 20:10:27,107 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1689970226544.f19224918f8f0414d2b7a4e76c5347d7., pid=15, masterSystemTime=1689970227044 2023-07-21 20:10:27,107 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1689970226544.85b0b0c0e18b94d85855e4e449e09302. 2023-07-21 20:10:27,107 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1689970226544.85b0b0c0e18b94d85855e4e449e09302. 2023-07-21 20:10:27,108 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=85b0b0c0e18b94d85855e4e449e09302, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:10:27,109 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1689970226544.85b0b0c0e18b94d85855e4e449e09302.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689970227108"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689970227108"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689970227108"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689970227108"}]},"ts":"1689970227108"} 2023-07-21 20:10:27,109 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1689970226544.f19224918f8f0414d2b7a4e76c5347d7. 2023-07-21 20:10:27,109 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1689970226544.f19224918f8f0414d2b7a4e76c5347d7. 2023-07-21 20:10:27,110 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=f19224918f8f0414d2b7a4e76c5347d7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:10:27,113 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1689970226544.f19224918f8f0414d2b7a4e76c5347d7.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689970227110"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689970227110"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689970227110"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689970227110"}]},"ts":"1689970227110"} 2023-07-21 20:10:27,121 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=13 2023-07-21 20:10:27,131 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=13, state=SUCCESS; OpenRegionProcedure 85b0b0c0e18b94d85855e4e449e09302, server=jenkins-hbase4.apache.org,37823,1689970216018 in 222 msec 2023-07-21 20:10:27,130 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=14, resume processing ppid=12 2023-07-21 20:10:27,126 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=85b0b0c0e18b94d85855e4e449e09302, ASSIGN in 398 msec 2023-07-21 20:10:27,132 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=f19224918f8f0414d2b7a4e76c5347d7, ASSIGN in 400 msec 2023-07-21 20:10:27,124 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=14 2023-07-21 20:10:27,132 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=14, state=SUCCESS; OpenRegionProcedure f19224918f8f0414d2b7a4e76c5347d7, server=jenkins-hbase4.apache.org,40099,1689970215928 in 226 msec 2023-07-21 20:10:27,133 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-21 20:10:27,133 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689970227133"}]},"ts":"1689970227133"} 2023-07-21 20:10:27,135 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-07-21 20:10:27,139 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-07-21 20:10:27,144 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-07-21 20:10:27,152 DEBUG [PEWorker-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 20:10:27,161 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-21 20:10:27,163 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53238, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 20:10:27,171 DEBUG [hconnection-0x1ad6c49f-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 20:10:27,175 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37154, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=ClientService 2023-07-21 20:10:27,187 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37823] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-21 20:10:27,237 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-21 20:10:27,237 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-21 20:10:27,237 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-21 20:10:27,237 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-21 20:10:27,238 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-21 20:10:27,255 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-21 20:10:27,255 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-21 20:10:27,257 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-21 20:10:27,257 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-21 20:10:27,260 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 711 msec 2023-07-21 20:10:27,663 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-21 20:10:27,663 INFO [Listener at jenkins-hbase4.apache.org/38105] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-07-21 20:10:27,667 DEBUG [Listener at jenkins-hbase4.apache.org/38105] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-21 20:10:27,669 DEBUG [Listener at jenkins-hbase4.apache.org/38105] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1689970226544.85b0b0c0e18b94d85855e4e449e09302. 2023-07-21 20:10:27,671 INFO [Listener at jenkins-hbase4.apache.org/38105] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-21 20:10:27,693 DEBUG [hconnection-0x5dbe67be-shared-pool-4] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 20:10:27,696 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53252, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 20:10:27,714 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-21 20:10:27,714 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689970227714 (current time:1689970227714). 2023-07-21 20:10:27,714 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-21 20:10:27,715 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] zookeeper.ReadOnlyZKClient(139): Connect 0x77bf68cf to 127.0.0.1:59101 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 20:10:27,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6d792e0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 20:10:27,723 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 20:10:27,727 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37164, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 20:10:27,729 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x77bf68cf to 127.0.0.1:59101 2023-07-21 20:10:27,729 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 20:10:27,731 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] zookeeper.ReadOnlyZKClient(139): Connect 0x7ccca1c1 to 127.0.0.1:59101 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 20:10:27,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2e7ef777, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 20:10:27,748 DEBUG [hconnection-0x78b46541-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 20:10:27,749 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37170, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 20:10:27,756 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 20:10:27,759 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53268, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 20:10:27,760 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7ccca1c1 to 127.0.0.1:59101 2023-07-21 20:10:27,760 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 20:10:27,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-21 20:10:27,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-21 20:10:27,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-21 20:10:27,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] procedure2.ProcedureExecutor(1029): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-21 20:10:27,828 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-21 20:10:27,832 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689970827832 2023-07-21 20:10:27,832 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-21 20:10:27,832 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-21 20:10:27,836 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-21 20:10:27,839 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-21 20:10:27,841 DEBUG [Listener at jenkins-hbase4.apache.org/38105] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-21 20:10:27,842 DEBUG [Listener at jenkins-hbase4.apache.org/38105] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-21 20:10:27,843 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 22 msec 2023-07-21 20:10:27,845 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-21 20:10:27,846 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689970827846 2023-07-21 20:10:27,879 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:27,880 INFO [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-07-21 20:10:27,880 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 20:10:27,881 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-07-21 20:10:27,881 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-21 20:10:27,882 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:27,882 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:27,887 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:10:27,887 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:10:27,887 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:10:27,887 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:10:27,887 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:10:27,887 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:10:27,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:10:27,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:10:27,887 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:10:27,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:10:27,888 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:10:27,888 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:10:27,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:27,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:27,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:27,889 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:10:27,889 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:27,889 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-21 20:10:27,889 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:27,889 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:27,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-21 20:10:27,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-21 20:10:27,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-21 20:10:27,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:27,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:27,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:27,891 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-21 20:10:27,891 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-21 20:10:27,891 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-21 20:10:27,894 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:27,894 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:27,898 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:27,899 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-21 20:10:27,899 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-21 20:10:27,899 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 20:10:27,899 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 20:10:27,899 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-21 20:10:27,901 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-21 20:10:27,900 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-21 20:10:27,901 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-21 20:10:27,901 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 20:10:27,901 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37823,1689970216018' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-21 20:10:27,901 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-21 20:10:27,902 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-21 20:10:27,902 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-21 20:10:27,902 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40099,1689970215928' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-21 20:10:27,902 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34071,1689970216065' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-21 20:10:27,905 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:27,905 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:10:27,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:10:27,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 20:10:27,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 20:10:27,906 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:27,906 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:27,906 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:10:27,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 20:10:27,906 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:27,906 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 20:10:27,907 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:27,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 20:10:27,907 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 20:10:27,907 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:27,907 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 20:10:27,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:27,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:10:27,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:10:27,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:10:27,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 20:10:27,910 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37823,1689970216018' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-21 20:10:27,911 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@46753729[Count = 1] remaining members to acquire global barrier 2023-07-21 20:10:27,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:10:27,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 20:10:27,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 20:10:27,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 20:10:27,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 20:10:27,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:27,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:10:27,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:10:27,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:10:27,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 20:10:27,914 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40099,1689970215928' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-21 20:10:27,914 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@46753729[Count = 0] remaining members to acquire global barrier 2023-07-21 20:10:27,914 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-21 20:10:27,914 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:27,918 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:27,918 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:27,918 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:27,918 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:27,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:27,918 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:27,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:27,918 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:27,918 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-21 20:10:27,918 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:10:27,918 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-21 20:10:27,918 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-21 20:10:27,919 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,34071,1689970216065' in zk 2023-07-21 20:10:27,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:27,919 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-21 20:10:27,919 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:10:27,919 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-21 20:10:27,920 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 20:10:27,920 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 20:10:27,920 DEBUG [rs(jenkins-hbase4.apache.org,37823,1689970216018)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689970226544.85b0b0c0e18b94d85855e4e449e09302. 2023-07-21 20:10:27,920 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 20:10:27,921 DEBUG [rs(jenkins-hbase4.apache.org,40099,1689970215928)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689970226544.f19224918f8f0414d2b7a4e76c5347d7. 2023-07-21 20:10:27,921 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 20:10:27,922 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-21 20:10:27,922 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 20:10:27,922 DEBUG [rs(jenkins-hbase4.apache.org,37823,1689970216018)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689970226544.85b0b0c0e18b94d85855e4e449e09302. started... 2023-07-21 20:10:27,922 DEBUG [rs(jenkins-hbase4.apache.org,40099,1689970215928)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689970226544.f19224918f8f0414d2b7a4e76c5347d7. started... 2023-07-21 20:10:27,922 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-21 20:10:27,930 DEBUG [rs(jenkins-hbase4.apache.org,40099,1689970215928)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f19224918f8f0414d2b7a4e76c5347d7: 2023-07-21 20:10:27,930 DEBUG [rs(jenkins-hbase4.apache.org,37823,1689970216018)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 85b0b0c0e18b94d85855e4e449e09302: 2023-07-21 20:10:27,931 DEBUG [rs(jenkins-hbase4.apache.org,40099,1689970215928)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689970226544.f19224918f8f0414d2b7a4e76c5347d7.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:27,931 DEBUG [rs(jenkins-hbase4.apache.org,37823,1689970216018)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689970226544.85b0b0c0e18b94d85855e4e449e09302.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:27,941 DEBUG [rs(jenkins-hbase4.apache.org,40099,1689970215928)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 20:10:27,941 DEBUG [rs(jenkins-hbase4.apache.org,37823,1689970216018)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 20:10:27,942 DEBUG [Listener at jenkins-hbase4.apache.org/38105] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 20:10:27,945 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-21 20:10:27,947 DEBUG [rs(jenkins-hbase4.apache.org,40099,1689970215928)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-21 20:10:27,947 DEBUG [rs(jenkins-hbase4.apache.org,37823,1689970216018)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-21 20:10:27,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-21 20:10:27,947 DEBUG [Listener at jenkins-hbase4.apache.org/38105] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-21 20:10:28,014 DEBUG [rs(jenkins-hbase4.apache.org,40099,1689970215928)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689970226544.f19224918f8f0414d2b7a4e76c5347d7. completed. 2023-07-21 20:10:28,015 DEBUG [rs(jenkins-hbase4.apache.org,40099,1689970215928)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689970226544.f19224918f8f0414d2b7a4e76c5347d7. 2023-07-21 20:10:28,015 DEBUG [rs(jenkins-hbase4.apache.org,37823,1689970216018)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689970226544.85b0b0c0e18b94d85855e4e449e09302. completed. 2023-07-21 20:10:28,015 DEBUG [rs(jenkins-hbase4.apache.org,37823,1689970216018)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689970226544.85b0b0c0e18b94d85855e4e449e09302. 2023-07-21 20:10:28,015 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 20:10:28,015 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 20:10:28,015 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:10:28,016 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-21 20:10:28,016 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,37823,1689970216018' in zk 2023-07-21 20:10:28,016 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 20:10:28,016 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 20:10:28,016 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:10:28,016 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-21 20:10:28,016 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,40099,1689970215928' in zk 2023-07-21 20:10:28,018 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:10:28,018 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-21 20:10:28,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:10:28,018 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 20:10:28,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 20:10:28,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 20:10:28,018 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-21 20:10:28,020 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:10:28,020 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-21 20:10:28,020 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 20:10:28,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 20:10:28,020 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-21 20:10:28,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 20:10:28,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:28,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:10:28,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:10:28,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:10:28,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 20:10:28,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:28,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:10:28,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:10:28,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:10:28,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,37823,1689970216018': 2023-07-21 20:10:28,026 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37823,1689970216018' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-21 20:10:28,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:10:28,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 20:10:28,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 20:10:28,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 20:10:28,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 20:10:28,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:28,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:10:28,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:10:28,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:10:28,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 20:10:28,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:28,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:10:28,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:10:28,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:10:28,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,40099,1689970215928': 2023-07-21 20:10:28,032 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40099,1689970215928' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-21 20:10:28,032 INFO [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-07-21 20:10:28,032 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-21 20:10:28,032 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-21 20:10:28,032 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:28,032 INFO [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-21 20:10:28,035 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:28,035 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:28,036 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:28,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:28,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:28,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 20:10:28,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 20:10:28,035 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:28,035 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:10:28,036 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:28,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:28,037 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:10:28,035 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:28,037 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:10:28,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 20:10:28,036 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:10:28,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:10:28,037 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:10:28,037 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:28,037 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:10:28,037 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:10:28,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:28,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:28,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:28,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:10:28,038 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:10:28,038 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:10:28,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 20:10:28,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:10:28,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:28,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:28,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:10:28,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:10:28,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:10:28,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:28,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 20:10:28,043 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:10:28,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:28,044 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:10:28,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:10:28,044 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:10:28,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:10:28,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:10:28,059 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:10:28,059 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:10:28,060 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:10:28,060 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:10:28,060 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:10:28,060 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:10:28,060 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:10:28,060 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:10:28,060 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:10:28,060 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:10:28,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:10:28,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:10:28,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:10:28,061 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:10:28,061 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:28,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:10:28,061 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:10:28,061 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 20:10:28,061 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:10:28,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:10:28,061 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:28,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:10:28,062 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-07-21 20:10:28,061 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:10:28,062 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:10:28,062 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:28,062 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:10:28,062 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:28,062 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:28,063 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-21 20:10:28,063 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:10:28,063 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:10:28,063 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:28,063 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:28,064 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-21 20:10:28,084 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:28,087 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:28,147 DEBUG [Listener at jenkins-hbase4.apache.org/38105] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 20:10:28,149 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-21 20:10:28,149 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-21 20:10:28,149 DEBUG [Listener at jenkins-hbase4.apache.org/38105] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-21 20:10:28,157 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:28,223 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-21 20:10:28,223 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:28,224 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:28,224 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689970227832Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1689970228084 (+252 ms)Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1689970228084Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1689970228084Writing data manifest for emptySnaptb0-testExportWithTargetName at 1689970228103 (+19 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1689970228139 (+36 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689970228223 (+84 ms) 2023-07-21 20:10:28,226 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-21 20:10:28,229 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 391 msec 2023-07-21 20:10:28,450 DEBUG [Listener at jenkins-hbase4.apache.org/38105] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 20:10:28,453 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-21 20:10:28,453 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-21 20:10:28,469 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37823] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1689970226544.85b0b0c0e18b94d85855e4e449e09302. with WAL disabled. Data may be lost in the event of a crash. 2023-07-21 20:10:28,471 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1689970226544.f19224918f8f0414d2b7a4e76c5347d7. with WAL disabled. Data may be lost in the event of a crash. 2023-07-21 20:10:28,477 DEBUG [Listener at jenkins-hbase4.apache.org/38105] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-21 20:10:28,477 DEBUG [Listener at jenkins-hbase4.apache.org/38105] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1689970226544.85b0b0c0e18b94d85855e4e449e09302. 2023-07-21 20:10:28,477 INFO [Listener at jenkins-hbase4.apache.org/38105] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-21 20:10:28,495 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-21 20:10:28,495 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689970228495 (current time:1689970228495). 2023-07-21 20:10:28,495 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-21 20:10:28,496 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] zookeeper.ReadOnlyZKClient(139): Connect 0x52ebbc29 to 127.0.0.1:59101 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 20:10:28,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@73aea445, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 20:10:28,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 20:10:28,519 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37176, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 20:10:28,524 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x52ebbc29 to 127.0.0.1:59101 2023-07-21 20:10:28,524 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 20:10:28,524 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] zookeeper.ReadOnlyZKClient(139): Connect 0x5586534a to 127.0.0.1:59101 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 20:10:28,533 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1280a33b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 20:10:28,536 DEBUG [hconnection-0x3fd0109-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 20:10:28,540 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37186, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 20:10:28,547 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 20:10:28,551 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53280, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 20:10:28,552 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5586534a to 127.0.0.1:59101 2023-07-21 20:10:28,552 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 20:10:28,552 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-21 20:10:28,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-21 20:10:28,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-21 20:10:28,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-21 20:10:28,559 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-21 20:10:28,560 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689970828560 2023-07-21 20:10:28,560 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-21 20:10:28,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-21 20:10:28,564 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-21 20:10:28,564 DEBUG [Listener at jenkins-hbase4.apache.org/38105] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-21 20:10:28,564 DEBUG [Listener at jenkins-hbase4.apache.org/38105] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-21 20:10:28,564 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-21 20:10:28,566 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 8 msec 2023-07-21 20:10:28,567 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-21 20:10:28,569 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689970828569 2023-07-21 20:10:28,593 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-07-21 20:10:28,593 INFO [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-07-21 20:10:28,594 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 20:10:28,595 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-07-21 20:10:28,595 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-21 20:10:28,596 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-21 20:10:28,596 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-21 20:10:28,598 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:10:28,598 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:10:28,598 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:10:28,599 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:10:28,599 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:10:28,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:10:28,598 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:10:28,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:10:28,599 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:10:28,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:10:28,599 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:10:28,599 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:10:28,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-21 20:10:28,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-21 20:10:28,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-21 20:10:28,600 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:10:28,600 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-21 20:10:28,600 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-21 20:10:28,600 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-21 20:10:28,600 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-21 20:10:28,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-21 20:10:28,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-21 20:10:28,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-21 20:10:28,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-21 20:10:28,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-21 20:10:28,601 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-21 20:10:28,601 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-21 20:10:28,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-21 20:10:28,601 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-21 20:10:28,601 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-21 20:10:28,601 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-21 20:10:28,601 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-21 20:10:28,601 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-21 20:10:28,601 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 20:10:28,601 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-21 20:10:28,601 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 20:10:28,603 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-21 20:10:28,604 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-21 20:10:28,604 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-21 20:10:28,604 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 20:10:28,603 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-21 20:10:28,605 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-21 20:10:28,605 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-21 20:10:28,604 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34071,1689970216065' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-21 20:10:28,605 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37823,1689970216018' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-21 20:10:28,605 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-21 20:10:28,605 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40099,1689970215928' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-21 20:10:28,607 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-21 20:10:28,608 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-21 20:10:28,608 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:10:28,608 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-21 20:10:28,608 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-21 20:10:28,608 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 20:10:28,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:10:28,609 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-21 20:10:28,609 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 20:10:28,608 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:10:28,609 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-21 20:10:28,609 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 20:10:28,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 20:10:28,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 20:10:28,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 20:10:28,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 20:10:28,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-21 20:10:28,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:10:28,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:10:28,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:10:28,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 20:10:28,613 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37823,1689970216018' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-21 20:10:28,613 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@e0692e6[Count = 1] remaining members to acquire global barrier 2023-07-21 20:10:28,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:10:28,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 20:10:28,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 20:10:28,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 20:10:28,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 20:10:28,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-21 20:10:28,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:10:28,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:10:28,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:10:28,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 20:10:28,617 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40099,1689970215928' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-21 20:10:28,617 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@e0692e6[Count = 0] remaining members to acquire global barrier 2023-07-21 20:10:28,617 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-21 20:10:28,617 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-21 20:10:28,622 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-21 20:10:28,622 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-21 20:10:28,622 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-21 20:10:28,622 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-21 20:10:28,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-21 20:10:28,622 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-21 20:10:28,623 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-21 20:10:28,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-21 20:10:28,623 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-21 20:10:28,623 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-21 20:10:28,623 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-21 20:10:28,623 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:10:28,623 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,34071,1689970216065' in zk 2023-07-21 20:10:28,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-21 20:10:28,623 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-21 20:10:28,623 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:10:28,624 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-21 20:10:28,624 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 20:10:28,624 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 20:10:28,624 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 20:10:28,624 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 20:10:28,624 DEBUG [rs(jenkins-hbase4.apache.org,40099,1689970215928)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689970226544.f19224918f8f0414d2b7a4e76c5347d7. 2023-07-21 20:10:28,624 DEBUG [rs(jenkins-hbase4.apache.org,37823,1689970216018)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689970226544.85b0b0c0e18b94d85855e4e449e09302. 2023-07-21 20:10:28,624 DEBUG [rs(jenkins-hbase4.apache.org,40099,1689970215928)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689970226544.f19224918f8f0414d2b7a4e76c5347d7. started... 2023-07-21 20:10:28,624 DEBUG [rs(jenkins-hbase4.apache.org,37823,1689970216018)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689970226544.85b0b0c0e18b94d85855e4e449e09302. started... 2023-07-21 20:10:28,624 INFO [rs(jenkins-hbase4.apache.org,37823,1689970216018)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 85b0b0c0e18b94d85855e4e449e09302 1/1 column families, dataSize=467 B heapSize=1.23 KB 2023-07-21 20:10:28,624 INFO [rs(jenkins-hbase4.apache.org,40099,1689970215928)-snapshot-pool-0] regionserver.HRegion(2745): Flushing f19224918f8f0414d2b7a4e76c5347d7 1/1 column families, dataSize=2.80 KB heapSize=6.30 KB 2023-07-21 20:10:28,627 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-21 20:10:28,627 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 20:10:28,627 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-21 20:10:28,664 DEBUG [Listener at jenkins-hbase4.apache.org/38105] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 20:10:28,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-21 20:10:28,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-21 20:10:28,667 DEBUG [Listener at jenkins-hbase4.apache.org/38105] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-21 20:10:28,784 INFO [rs(jenkins-hbase4.apache.org,40099,1689970215928)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230721e1e4a3bacf2d4420a9dcd05fb04f30d3 to hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230721e1e4a3bacf2d4420a9dcd05fb04f30d3 2023-07-21 20:10:28,784 INFO [rs(jenkins-hbase4.apache.org,37823,1689970216018)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307218a905d1bf14f4a118a1a98099f4609d3 to hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202307218a905d1bf14f4a118a1a98099f4609d3 2023-07-21 20:10:28,829 INFO [rs(jenkins-hbase4.apache.org,40099,1689970215928)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.8 K, hasBloomFilter=true, into tmp file hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testExportWithTargetName/f19224918f8f0414d2b7a4e76c5347d7/.tmp/cf/9a84be4d663a42198419f1582e7fa4af 2023-07-21 20:10:28,833 INFO [rs(jenkins-hbase4.apache.org,37823,1689970216018)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=467, hasBloomFilter=true, into tmp file hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testExportWithTargetName/85b0b0c0e18b94d85855e4e449e09302/.tmp/cf/81086b691e23492f8516f95df0307f40 2023-07-21 20:10:28,843 DEBUG [rs(jenkins-hbase4.apache.org,40099,1689970215928)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testExportWithTargetName/f19224918f8f0414d2b7a4e76c5347d7/.tmp/cf/9a84be4d663a42198419f1582e7fa4af as hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testExportWithTargetName/f19224918f8f0414d2b7a4e76c5347d7/cf/9a84be4d663a42198419f1582e7fa4af 2023-07-21 20:10:28,844 DEBUG [rs(jenkins-hbase4.apache.org,37823,1689970216018)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testExportWithTargetName/85b0b0c0e18b94d85855e4e449e09302/.tmp/cf/81086b691e23492f8516f95df0307f40 as hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testExportWithTargetName/85b0b0c0e18b94d85855e4e449e09302/cf/81086b691e23492f8516f95df0307f40 2023-07-21 20:10:28,852 INFO [rs(jenkins-hbase4.apache.org,40099,1689970215928)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testExportWithTargetName/f19224918f8f0414d2b7a4e76c5347d7/cf/9a84be4d663a42198419f1582e7fa4af, entries=43, sequenceid=6, filesize=12.1 K 2023-07-21 20:10:28,854 INFO [rs(jenkins-hbase4.apache.org,37823,1689970216018)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testExportWithTargetName/85b0b0c0e18b94d85855e4e449e09302/cf/81086b691e23492f8516f95df0307f40, entries=7, sequenceid=6, filesize=6.1 K 2023-07-21 20:10:28,858 INFO [rs(jenkins-hbase4.apache.org,37823,1689970216018)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~467 B/467, heapSize ~1.22 KB/1248, currentSize=0 B/0 for 85b0b0c0e18b94d85855e4e449e09302 in 234ms, sequenceid=6, compaction requested=false 2023-07-21 20:10:28,858 DEBUG [rs(jenkins-hbase4.apache.org,37823,1689970216018)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-21 20:10:28,858 INFO [rs(jenkins-hbase4.apache.org,40099,1689970215928)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.80 KB/2869, heapSize ~6.28 KB/6432, currentSize=0 B/0 for f19224918f8f0414d2b7a4e76c5347d7 in 234ms, sequenceid=6, compaction requested=false 2023-07-21 20:10:28,859 DEBUG [rs(jenkins-hbase4.apache.org,40099,1689970215928)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-21 20:10:28,861 DEBUG [rs(jenkins-hbase4.apache.org,37823,1689970216018)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 85b0b0c0e18b94d85855e4e449e09302: 2023-07-21 20:10:28,861 DEBUG [rs(jenkins-hbase4.apache.org,40099,1689970215928)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f19224918f8f0414d2b7a4e76c5347d7: 2023-07-21 20:10:28,862 DEBUG [rs(jenkins-hbase4.apache.org,37823,1689970216018)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689970226544.85b0b0c0e18b94d85855e4e449e09302.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-21 20:10:28,862 DEBUG [rs(jenkins-hbase4.apache.org,37823,1689970216018)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 20:10:28,862 DEBUG [rs(jenkins-hbase4.apache.org,40099,1689970215928)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689970226544.f19224918f8f0414d2b7a4e76c5347d7.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-21 20:10:28,862 DEBUG [rs(jenkins-hbase4.apache.org,37823,1689970216018)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testExportWithTargetName/85b0b0c0e18b94d85855e4e449e09302/cf/81086b691e23492f8516f95df0307f40] hfiles 2023-07-21 20:10:28,862 DEBUG [rs(jenkins-hbase4.apache.org,40099,1689970215928)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 20:10:28,862 DEBUG [rs(jenkins-hbase4.apache.org,37823,1689970216018)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testExportWithTargetName/85b0b0c0e18b94d85855e4e449e09302/cf/81086b691e23492f8516f95df0307f40 for snapshot=snaptb0-testExportWithTargetName 2023-07-21 20:10:28,862 DEBUG [rs(jenkins-hbase4.apache.org,40099,1689970215928)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testExportWithTargetName/f19224918f8f0414d2b7a4e76c5347d7/cf/9a84be4d663a42198419f1582e7fa4af] hfiles 2023-07-21 20:10:28,862 DEBUG [rs(jenkins-hbase4.apache.org,40099,1689970215928)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testExportWithTargetName/f19224918f8f0414d2b7a4e76c5347d7/cf/9a84be4d663a42198419f1582e7fa4af for snapshot=snaptb0-testExportWithTargetName 2023-07-21 20:10:28,867 DEBUG [Listener at jenkins-hbase4.apache.org/38105] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 20:10:28,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-21 20:10:28,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-21 20:10:28,872 DEBUG [Listener at jenkins-hbase4.apache.org/38105] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-21 20:10:28,902 DEBUG [rs(jenkins-hbase4.apache.org,37823,1689970216018)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689970226544.85b0b0c0e18b94d85855e4e449e09302. completed. 2023-07-21 20:10:28,902 DEBUG [rs(jenkins-hbase4.apache.org,37823,1689970216018)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689970226544.85b0b0c0e18b94d85855e4e449e09302. 2023-07-21 20:10:28,902 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 20:10:28,902 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 20:10:28,902 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:10:28,902 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-21 20:10:28,902 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,37823,1689970216018' in zk 2023-07-21 20:10:28,906 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-21 20:10:28,906 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:10:28,906 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 20:10:28,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:10:28,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 20:10:28,906 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-21 20:10:28,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 20:10:28,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 20:10:28,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 20:10:28,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-21 20:10:28,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:10:28,910 DEBUG [rs(jenkins-hbase4.apache.org,40099,1689970215928)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689970226544.f19224918f8f0414d2b7a4e76c5347d7. completed. 2023-07-21 20:10:28,910 DEBUG [rs(jenkins-hbase4.apache.org,40099,1689970215928)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689970226544.f19224918f8f0414d2b7a4e76c5347d7. 2023-07-21 20:10:28,910 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 20:10:28,910 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 20:10:28,910 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:10:28,910 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-21 20:10:28,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:10:28,910 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,40099,1689970215928' in zk 2023-07-21 20:10:28,913 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-21 20:10:28,913 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 20:10:28,913 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-21 20:10:28,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:10:28,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 20:10:28,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-21 20:10:28,916 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:10:28,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:10:28,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:10:28,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:10:28,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,37823,1689970216018': 2023-07-21 20:10:28,918 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37823,1689970216018' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-21 20:10:28,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:10:28,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 20:10:28,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 20:10:28,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 20:10:28,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 20:10:28,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-21 20:10:28,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:10:28,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:10:28,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:10:28,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 20:10:28,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-21 20:10:28,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:10:28,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:10:28,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:10:28,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,40099,1689970215928': 2023-07-21 20:10:28,923 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40099,1689970215928' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-21 20:10:28,923 INFO [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-07-21 20:10:28,923 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-21 20:10:28,923 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-21 20:10:28,923 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-07-21 20:10:28,923 INFO [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-21 20:10:28,926 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-21 20:10:28,926 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-21 20:10:28,926 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:10:28,926 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-21 20:10:28,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-21 20:10:28,927 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-21 20:10:28,927 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:10:28,926 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-21 20:10:28,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-21 20:10:28,926 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:10:28,927 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-21 20:10:28,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-21 20:10:28,931 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-21 20:10:28,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-21 20:10:28,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 20:10:28,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 20:10:28,932 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:10:28,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 20:10:28,932 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:10:28,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:10:28,932 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:10:28,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:10:28,933 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:10:28,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-21 20:10:28,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:10:28,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-21 20:10:28,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-21 20:10:28,938 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:10:28,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-21 20:10:28,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 20:10:28,939 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:10:28,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-21 20:10:28,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:10:28,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:10:28,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:10:28,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 20:10:28,943 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:10:28,943 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:10:28,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-21 20:10:28,944 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:10:28,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:10:28,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:10:28,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:10:28,963 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:10:28,963 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:10:28,963 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:10:28,963 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 20:10:28,963 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:10:28,963 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:10:28,963 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:10:28,967 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:10:28,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:10:28,967 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:10:28,967 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:10:28,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:10:28,967 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-21 20:10:28,967 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:10:28,967 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:10:28,967 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-21 20:10:28,967 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:10:28,967 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-21 20:10:28,967 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:10:28,967 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:10:28,968 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-21 20:10:28,968 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-21 20:10:28,967 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:10:28,963 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-07-21 20:10:28,968 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-07-21 20:10:28,968 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-21 20:10:28,968 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-21 20:10:28,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:10:28,968 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:10:28,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:10:28,967 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:10:28,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:10:28,969 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:10:28,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:10:28,970 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230721e1e4a3bacf2d4420a9dcd05fb04f30d3, hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202307218a905d1bf14f4a118a1a98099f4609d3] mob files 2023-07-21 20:10:28,970 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230721e1e4a3bacf2d4420a9dcd05fb04f30d3 2023-07-21 20:10:28,970 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202307218a905d1bf14f4a118a1a98099f4609d3 2023-07-21 20:10:28,996 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-07-21 20:10:28,997 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-21 20:10:29,046 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-21 20:10:29,097 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-21 20:10:29,097 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-21 20:10:29,097 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-21 20:10:29,097 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689970228560Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1689970228996 (+436 ms)Consolidate snapshot: snaptb0-testExportWithTargetName at 1689970228996Loading Region manifests for snaptb0-testExportWithTargetName at 1689970228996Writing data manifest for snaptb0-testExportWithTargetName at 1689970229006 (+10 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1689970229032 (+26 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689970229097 (+65 ms) 2023-07-21 20:10:29,099 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-21 20:10:29,102 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 538 msec 2023-07-21 20:10:29,173 DEBUG [Listener at jenkins-hbase4.apache.org/38105] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 20:10:29,176 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-21 20:10:29,176 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-21 20:10:29,177 INFO [Listener at jenkins-hbase4.apache.org/38105] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/export-test/export-1689970229176 2023-07-21 20:10:29,177 INFO [Listener at jenkins-hbase4.apache.org/38105] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:40641, tgtDir=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/export-test/export-1689970229176, rawTgtDir=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/export-test/export-1689970229176, srcFsUri=hdfs://localhost:40641, srcDir=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00 2023-07-21 20:10:29,216 DEBUG [Listener at jenkins-hbase4.apache.org/38105] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:40641, inputRoot=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00 2023-07-21 20:10:29,216 DEBUG [Listener at jenkins-hbase4.apache.org/38105] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2123163544_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/export-test/export-1689970229176, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/export-test/export-1689970229176/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-21 20:10:29,216 INFO [Listener at jenkins-hbase4.apache.org/38105] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:40641, inputRoot=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00, snapshotDir=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-07-21 20:10:29,240 INFO [Listener at jenkins-hbase4.apache.org/38105] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/export-test/export-1689970229176/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-21 20:10:29,377 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-21 20:10:29,379 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-21 20:10:29,380 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-21 20:10:29,380 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-21 20:10:30,410 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c4475fbf-6a12-c189-d7a2-889953ef4b74/hadoop-1375456832842779391.jar 2023-07-21 20:10:30,411 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-21 20:10:30,411 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-21 20:10:30,493 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c4475fbf-6a12-c189-d7a2-889953ef4b74/hadoop-3645120529315244439.jar 2023-07-21 20:10:30,494 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-21 20:10:30,495 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-21 20:10:30,495 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-21 20:10:30,496 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-21 20:10:30,497 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-21 20:10:30,497 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-21 20:10:30,498 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-21 20:10:30,498 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-21 20:10:30,499 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-21 20:10:30,499 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-21 20:10:30,500 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-21 20:10:30,500 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-21 20:10:30,501 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-21 20:10:30,501 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-21 20:10:30,501 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-21 20:10:30,502 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-21 20:10:30,507 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 20:10:30,507 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 20:10:30,508 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-21 20:10:30,508 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 20:10:30,508 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 20:10:30,509 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-21 20:10:30,509 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-21 20:10:32,077 WARN [Listener at jenkins-hbase4.apache.org/38105] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-21 20:10:32,083 INFO [Listener at jenkins-hbase4.apache.org/38105] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-07-21 20:10:32,093 DEBUG [Listener at jenkins-hbase4.apache.org/38105] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-07-21 20:10:32,574 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-21 20:10:32,683 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-21 20:10:32,683 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-21 20:10:33,199 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689970225203_0001_000001 (auth:SIMPLE) 2023-07-21 20:10:38,611 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689970225203_0001_000001 (auth:SIMPLE) 2023-07-21 20:10:40,893 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689970225203_0001_000001 (auth:SIMPLE) 2023-07-21 20:10:44,345 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689970225203_0001_000001 (auth:SIMPLE) 2023-07-21 20:10:46,097 INFO [Listener at jenkins-hbase4.apache.org/38105] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-21 20:10:46,099 INFO [Listener at jenkins-hbase4.apache.org/38105] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-21 20:10:46,110 INFO [Listener at jenkins-hbase4.apache.org/38105] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-07-21 20:10:46,110 INFO [Listener at jenkins-hbase4.apache.org/38105] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-21 20:10:46,111 INFO [Listener at jenkins-hbase4.apache.org/38105] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-21 20:10:46,111 DEBUG [Listener at jenkins-hbase4.apache.org/38105] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_895530006_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-21 20:10:46,112 DEBUG [Listener at jenkins-hbase4.apache.org/38105] snapshot.TestExportSnapshot(367): hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-07-21 20:10:46,112 DEBUG [Listener at jenkins-hbase4.apache.org/38105] snapshot.TestExportSnapshot(367): hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-07-21 20:10:46,112 DEBUG [Listener at jenkins-hbase4.apache.org/38105] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_895530006_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/export-test/export-1689970229176/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/export-test/export-1689970229176/.hbase-snapshot/testExportWithTargetName 2023-07-21 20:10:46,113 DEBUG [Listener at jenkins-hbase4.apache.org/38105] snapshot.TestExportSnapshot(367): hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/export-test/export-1689970229176/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-07-21 20:10:46,113 DEBUG [Listener at jenkins-hbase4.apache.org/38105] snapshot.TestExportSnapshot(367): hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/export-test/export-1689970229176/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-07-21 20:10:46,123 INFO [Listener at jenkins-hbase4.apache.org/38105] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-07-21 20:10:46,127 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-07-21 20:10:46,135 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] procedure2.ProcedureExecutor(1029): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-07-21 20:10:46,139 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689970246139"}]},"ts":"1689970246139"} 2023-07-21 20:10:46,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-21 20:10:46,141 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-07-21 20:10:46,143 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-07-21 20:10:46,145 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=85b0b0c0e18b94d85855e4e449e09302, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=f19224918f8f0414d2b7a4e76c5347d7, UNASSIGN}] 2023-07-21 20:10:46,147 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=85b0b0c0e18b94d85855e4e449e09302, UNASSIGN 2023-07-21 20:10:46,147 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=f19224918f8f0414d2b7a4e76c5347d7, UNASSIGN 2023-07-21 20:10:46,148 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=85b0b0c0e18b94d85855e4e449e09302, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:10:46,148 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689970226544.85b0b0c0e18b94d85855e4e449e09302.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689970246148"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689970246148"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689970246148"}]},"ts":"1689970246148"} 2023-07-21 20:10:46,148 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=f19224918f8f0414d2b7a4e76c5347d7, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:10:46,148 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689970226544.f19224918f8f0414d2b7a4e76c5347d7.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689970246148"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689970246148"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689970246148"}]},"ts":"1689970246148"} 2023-07-21 20:10:46,150 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=22, state=RUNNABLE; CloseRegionProcedure 85b0b0c0e18b94d85855e4e449e09302, server=jenkins-hbase4.apache.org,37823,1689970216018}] 2023-07-21 20:10:46,151 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=23, state=RUNNABLE; CloseRegionProcedure f19224918f8f0414d2b7a4e76c5347d7, server=jenkins-hbase4.apache.org,40099,1689970215928}] 2023-07-21 20:10:46,242 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-21 20:10:46,312 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 85b0b0c0e18b94d85855e4e449e09302 2023-07-21 20:10:46,312 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close f19224918f8f0414d2b7a4e76c5347d7 2023-07-21 20:10:46,312 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 85b0b0c0e18b94d85855e4e449e09302, disabling compactions & flushes 2023-07-21 20:10:46,312 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f19224918f8f0414d2b7a4e76c5347d7, disabling compactions & flushes 2023-07-21 20:10:46,312 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689970226544.85b0b0c0e18b94d85855e4e449e09302. 2023-07-21 20:10:46,312 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689970226544.f19224918f8f0414d2b7a4e76c5347d7. 2023-07-21 20:10:46,312 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689970226544.85b0b0c0e18b94d85855e4e449e09302. 2023-07-21 20:10:46,312 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689970226544.f19224918f8f0414d2b7a4e76c5347d7. 2023-07-21 20:10:46,312 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689970226544.85b0b0c0e18b94d85855e4e449e09302. after waiting 0 ms 2023-07-21 20:10:46,312 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689970226544.f19224918f8f0414d2b7a4e76c5347d7. after waiting 0 ms 2023-07-21 20:10:46,312 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689970226544.85b0b0c0e18b94d85855e4e449e09302. 2023-07-21 20:10:46,313 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689970226544.f19224918f8f0414d2b7a4e76c5347d7. 2023-07-21 20:10:46,326 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testExportWithTargetName/f19224918f8f0414d2b7a4e76c5347d7/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-21 20:10:46,326 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testExportWithTargetName/85b0b0c0e18b94d85855e4e449e09302/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-21 20:10:46,326 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 20:10:46,327 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 20:10:46,328 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689970226544.f19224918f8f0414d2b7a4e76c5347d7. 2023-07-21 20:10:46,328 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689970226544.85b0b0c0e18b94d85855e4e449e09302. 2023-07-21 20:10:46,328 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f19224918f8f0414d2b7a4e76c5347d7: 2023-07-21 20:10:46,328 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 85b0b0c0e18b94d85855e4e449e09302: 2023-07-21 20:10:46,330 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 85b0b0c0e18b94d85855e4e449e09302 2023-07-21 20:10:46,331 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=85b0b0c0e18b94d85855e4e449e09302, regionState=CLOSED 2023-07-21 20:10:46,331 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689970226544.85b0b0c0e18b94d85855e4e449e09302.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689970246331"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689970246331"}]},"ts":"1689970246331"} 2023-07-21 20:10:46,331 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed f19224918f8f0414d2b7a4e76c5347d7 2023-07-21 20:10:46,332 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=f19224918f8f0414d2b7a4e76c5347d7, regionState=CLOSED 2023-07-21 20:10:46,332 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689970226544.f19224918f8f0414d2b7a4e76c5347d7.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689970246332"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689970246332"}]},"ts":"1689970246332"} 2023-07-21 20:10:46,337 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=22 2023-07-21 20:10:46,338 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=22, state=SUCCESS; CloseRegionProcedure 85b0b0c0e18b94d85855e4e449e09302, server=jenkins-hbase4.apache.org,37823,1689970216018 in 185 msec 2023-07-21 20:10:46,338 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=23 2023-07-21 20:10:46,338 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=23, state=SUCCESS; CloseRegionProcedure f19224918f8f0414d2b7a4e76c5347d7, server=jenkins-hbase4.apache.org,40099,1689970215928 in 185 msec 2023-07-21 20:10:46,341 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=85b0b0c0e18b94d85855e4e449e09302, UNASSIGN in 193 msec 2023-07-21 20:10:46,343 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=21 2023-07-21 20:10:46,343 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=f19224918f8f0414d2b7a4e76c5347d7, UNASSIGN in 193 msec 2023-07-21 20:10:46,344 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689970246344"}]},"ts":"1689970246344"} 2023-07-21 20:10:46,346 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-07-21 20:10:46,350 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-07-21 20:10:46,353 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 221 msec 2023-07-21 20:10:46,444 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-21 20:10:46,444 INFO [Listener at jenkins-hbase4.apache.org/38105] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-07-21 20:10:46,450 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-07-21 20:10:46,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-21 20:10:46,461 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-21 20:10:46,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-07-21 20:10:46,463 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-21 20:10:46,468 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37823] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-07-21 20:10:46,472 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-21 20:10:46,472 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-21 20:10:46,472 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-21 20:10:46,472 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testExportWithTargetName/85b0b0c0e18b94d85855e4e449e09302 2023-07-21 20:10:46,472 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testExportWithTargetName/f19224918f8f0414d2b7a4e76c5347d7 2023-07-21 20:10:46,473 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-21 20:10:46,474 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-21 20:10:46,474 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-21 20:10:46,475 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-21 20:10:46,475 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-21 20:10:46,476 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testExportWithTargetName/f19224918f8f0414d2b7a4e76c5347d7/cf, FileablePath, hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testExportWithTargetName/f19224918f8f0414d2b7a4e76c5347d7/recovered.edits] 2023-07-21 20:10:46,476 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testExportWithTargetName/85b0b0c0e18b94d85855e4e449e09302/cf, FileablePath, hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testExportWithTargetName/85b0b0c0e18b94d85855e4e449e09302/recovered.edits] 2023-07-21 20:10:46,477 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-21 20:10:46,477 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-21 20:10:46,477 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-21 20:10:46,478 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 20:10:46,477 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 20:10:46,478 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-21 20:10:46,478 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 20:10:46,478 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 20:10:46,481 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-21 20:10:46,486 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testExportWithTargetName/f19224918f8f0414d2b7a4e76c5347d7/cf/9a84be4d663a42198419f1582e7fa4af to hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/archive/data/default/testtb-testExportWithTargetName/f19224918f8f0414d2b7a4e76c5347d7/cf/9a84be4d663a42198419f1582e7fa4af 2023-07-21 20:10:46,487 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testExportWithTargetName/85b0b0c0e18b94d85855e4e449e09302/cf/81086b691e23492f8516f95df0307f40 to hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/archive/data/default/testtb-testExportWithTargetName/85b0b0c0e18b94d85855e4e449e09302/cf/81086b691e23492f8516f95df0307f40 2023-07-21 20:10:46,494 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testExportWithTargetName/85b0b0c0e18b94d85855e4e449e09302/recovered.edits/9.seqid to hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/archive/data/default/testtb-testExportWithTargetName/85b0b0c0e18b94d85855e4e449e09302/recovered.edits/9.seqid 2023-07-21 20:10:46,494 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testExportWithTargetName/f19224918f8f0414d2b7a4e76c5347d7/recovered.edits/9.seqid to hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/archive/data/default/testtb-testExportWithTargetName/f19224918f8f0414d2b7a4e76c5347d7/recovered.edits/9.seqid 2023-07-21 20:10:46,495 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testExportWithTargetName/85b0b0c0e18b94d85855e4e449e09302 2023-07-21 20:10:46,495 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testExportWithTargetName/f19224918f8f0414d2b7a4e76c5347d7 2023-07-21 20:10:46,495 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-21 20:10:46,496 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-07-21 20:10:46,497 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf] 2023-07-21 20:10:46,502 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230721e1e4a3bacf2d4420a9dcd05fb04f30d3 to hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230721e1e4a3bacf2d4420a9dcd05fb04f30d3 2023-07-21 20:10:46,504 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202307218a905d1bf14f4a118a1a98099f4609d3 to hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202307218a905d1bf14f4a118a1a98099f4609d3 2023-07-21 20:10:46,504 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-07-21 20:10:46,508 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-21 20:10:46,530 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-07-21 20:10:46,533 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-07-21 20:10:46,535 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-21 20:10:46,535 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-07-21 20:10:46,535 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1689970226544.85b0b0c0e18b94d85855e4e449e09302.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689970246535"}]},"ts":"9223372036854775807"} 2023-07-21 20:10:46,535 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1689970226544.f19224918f8f0414d2b7a4e76c5347d7.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689970246535"}]},"ts":"9223372036854775807"} 2023-07-21 20:10:46,537 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-21 20:10:46,538 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 85b0b0c0e18b94d85855e4e449e09302, NAME => 'testtb-testExportWithTargetName,,1689970226544.85b0b0c0e18b94d85855e4e449e09302.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => f19224918f8f0414d2b7a4e76c5347d7, NAME => 'testtb-testExportWithTargetName,1,1689970226544.f19224918f8f0414d2b7a4e76c5347d7.', STARTKEY => '1', ENDKEY => ''}] 2023-07-21 20:10:46,538 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-07-21 20:10:46,538 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689970246538"}]},"ts":"9223372036854775807"} 2023-07-21 20:10:46,540 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-07-21 20:10:46,542 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-21 20:10:46,543 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 91 msec 2023-07-21 20:10:46,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-21 20:10:46,586 INFO [Listener at jenkins-hbase4.apache.org/38105] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-07-21 20:10:46,611 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-07-21 20:10:46,615 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:46,619 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-07-21 20:10:46,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-07-21 20:10:46,659 INFO [Listener at jenkins-hbase4.apache.org/38105] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=752 (was 706) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c4475fbf-6a12-c189-d7a2-889953ef4b74/cluster_35d154ca-3b63-9eae-c963-92b106b8418a/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1354340851) connection to jenkins-hbase4.apache.org/172.31.14.131:36607 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_895530006_17 at /127.0.0.1:36738 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_895530006_17 at /127.0.0.1:35624 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3e3f9760-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c4475fbf-6a12-c189-d7a2-889953ef4b74/cluster_35d154ca-3b63-9eae-c963-92b106b8418a/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: Thread-1316 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c4475fbf-6a12-c189-d7a2-889953ef4b74/cluster_35d154ca-3b63-9eae-c963-92b106b8418a/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3e3f9760-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1354340851) connection to jenkins-hbase4.apache.org/172.31.14.131:38189 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c4475fbf-6a12-c189-d7a2-889953ef4b74/cluster_35d154ca-3b63-9eae-c963-92b106b8418a/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1876126892_1 at /127.0.0.1:35618 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2123163544_17 at /127.0.0.1:40728 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c4475fbf-6a12-c189-d7a2-889953ef4b74/cluster_35d154ca-3b63-9eae-c963-92b106b8418a/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3e3f9760-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1876126892_1 at /127.0.0.1:40688 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3e3f9760-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c4475fbf-6a12-c189-d7a2-889953ef4b74/cluster_35d154ca-3b63-9eae-c963-92b106b8418a/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=918 (was 898) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=350 (was 304) - SystemLoadAverage LEAK? -, ProcessCount=185 (was 179) - ProcessCount LEAK? -, AvailableMemoryMB=7670 (was 9361) 2023-07-21 20:10:46,659 WARN [Listener at jenkins-hbase4.apache.org/38105] hbase.ResourceChecker(130): Thread=752 is superior to 500 2023-07-21 20:10:46,684 INFO [Listener at jenkins-hbase4.apache.org/38105] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=752, OpenFileDescriptor=918, MaxFileDescriptor=60000, SystemLoadAverage=350, ProcessCount=185, AvailableMemoryMB=7667 2023-07-21 20:10:46,685 WARN [Listener at jenkins-hbase4.apache.org/38105] hbase.ResourceChecker(130): Thread=752 is superior to 500 2023-07-21 20:10:46,687 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-21 20:10:46,690 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-07-21 20:10:46,698 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-21 20:10:46,700 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-07-21 20:10:46,701 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-21 20:10:46,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-21 20:10:46,705 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testExportFileSystemState/61ff8d76a4114ff2b666ca25e8c0f12f 2023-07-21 20:10:46,706 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testExportFileSystemState/e65a1ace54a369fb4144ac114de5090e 2023-07-21 20:10:46,706 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testExportFileSystemState/61ff8d76a4114ff2b666ca25e8c0f12f empty. 2023-07-21 20:10:46,706 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testExportFileSystemState/e65a1ace54a369fb4144ac114de5090e empty. 2023-07-21 20:10:46,707 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testExportFileSystemState/61ff8d76a4114ff2b666ca25e8c0f12f 2023-07-21 20:10:46,711 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testExportFileSystemState/e65a1ace54a369fb4144ac114de5090e 2023-07-21 20:10:46,711 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-21 20:10:46,733 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-21 20:10:46,734 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 61ff8d76a4114ff2b666ca25e8c0f12f, NAME => 'testtb-testExportFileSystemState,,1689970246687.61ff8d76a4114ff2b666ca25e8c0f12f.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp 2023-07-21 20:10:46,735 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => e65a1ace54a369fb4144ac114de5090e, NAME => 'testtb-testExportFileSystemState,1,1689970246687.e65a1ace54a369fb4144ac114de5090e.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp 2023-07-21 20:10:46,759 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689970246687.61ff8d76a4114ff2b666ca25e8c0f12f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 20:10:46,760 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 61ff8d76a4114ff2b666ca25e8c0f12f, disabling compactions & flushes 2023-07-21 20:10:46,760 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689970246687.61ff8d76a4114ff2b666ca25e8c0f12f. 2023-07-21 20:10:46,760 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689970246687.61ff8d76a4114ff2b666ca25e8c0f12f. 2023-07-21 20:10:46,760 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689970246687.61ff8d76a4114ff2b666ca25e8c0f12f. after waiting 0 ms 2023-07-21 20:10:46,760 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689970246687.61ff8d76a4114ff2b666ca25e8c0f12f. 2023-07-21 20:10:46,760 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689970246687.61ff8d76a4114ff2b666ca25e8c0f12f. 2023-07-21 20:10:46,761 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 61ff8d76a4114ff2b666ca25e8c0f12f: 2023-07-21 20:10:46,761 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689970246687.e65a1ace54a369fb4144ac114de5090e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 20:10:46,762 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing e65a1ace54a369fb4144ac114de5090e, disabling compactions & flushes 2023-07-21 20:10:46,762 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689970246687.e65a1ace54a369fb4144ac114de5090e. 2023-07-21 20:10:46,762 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689970246687.e65a1ace54a369fb4144ac114de5090e. 2023-07-21 20:10:46,762 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689970246687.e65a1ace54a369fb4144ac114de5090e. after waiting 0 ms 2023-07-21 20:10:46,762 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689970246687.e65a1ace54a369fb4144ac114de5090e. 2023-07-21 20:10:46,763 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689970246687.e65a1ace54a369fb4144ac114de5090e. 2023-07-21 20:10:46,763 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for e65a1ace54a369fb4144ac114de5090e: 2023-07-21 20:10:46,771 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-21 20:10:46,772 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689970246687.61ff8d76a4114ff2b666ca25e8c0f12f.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689970246771"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689970246771"}]},"ts":"1689970246771"} 2023-07-21 20:10:46,772 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689970246687.e65a1ace54a369fb4144ac114de5090e.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689970246771"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689970246771"}]},"ts":"1689970246771"} 2023-07-21 20:10:46,779 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-21 20:10:46,784 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-21 20:10:46,784 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689970246784"}]},"ts":"1689970246784"} 2023-07-21 20:10:46,786 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-07-21 20:10:46,790 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-21 20:10:46,791 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-21 20:10:46,791 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-21 20:10:46,791 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-21 20:10:46,791 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-21 20:10:46,792 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=61ff8d76a4114ff2b666ca25e8c0f12f, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=e65a1ace54a369fb4144ac114de5090e, ASSIGN}] 2023-07-21 20:10:46,795 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=e65a1ace54a369fb4144ac114de5090e, ASSIGN 2023-07-21 20:10:46,795 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=61ff8d76a4114ff2b666ca25e8c0f12f, ASSIGN 2023-07-21 20:10:46,797 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=61ff8d76a4114ff2b666ca25e8c0f12f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37823,1689970216018; forceNewPlan=false, retain=false 2023-07-21 20:10:46,797 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=e65a1ace54a369fb4144ac114de5090e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40099,1689970215928; forceNewPlan=false, retain=false 2023-07-21 20:10:46,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-21 20:10:46,948 INFO [jenkins-hbase4:41777] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-21 20:10:46,950 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=e65a1ace54a369fb4144ac114de5090e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:10:46,950 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=61ff8d76a4114ff2b666ca25e8c0f12f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:10:46,950 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689970246687.e65a1ace54a369fb4144ac114de5090e.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689970246950"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689970246950"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689970246950"}]},"ts":"1689970246950"} 2023-07-21 20:10:46,950 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689970246687.61ff8d76a4114ff2b666ca25e8c0f12f.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689970246950"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689970246950"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689970246950"}]},"ts":"1689970246950"} 2023-07-21 20:10:46,953 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=29, state=RUNNABLE; OpenRegionProcedure e65a1ace54a369fb4144ac114de5090e, server=jenkins-hbase4.apache.org,40099,1689970215928}] 2023-07-21 20:10:46,954 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=28, state=RUNNABLE; OpenRegionProcedure 61ff8d76a4114ff2b666ca25e8c0f12f, server=jenkins-hbase4.apache.org,37823,1689970216018}] 2023-07-21 20:10:47,004 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-21 20:10:47,108 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1689970246687.e65a1ace54a369fb4144ac114de5090e. 2023-07-21 20:10:47,108 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1689970246687.61ff8d76a4114ff2b666ca25e8c0f12f. 2023-07-21 20:10:47,109 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e65a1ace54a369fb4144ac114de5090e, NAME => 'testtb-testExportFileSystemState,1,1689970246687.e65a1ace54a369fb4144ac114de5090e.', STARTKEY => '1', ENDKEY => ''} 2023-07-21 20:10:47,109 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 61ff8d76a4114ff2b666ca25e8c0f12f, NAME => 'testtb-testExportFileSystemState,,1689970246687.61ff8d76a4114ff2b666ca25e8c0f12f.', STARTKEY => '', ENDKEY => '1'} 2023-07-21 20:10:47,109 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1689970246687.e65a1ace54a369fb4144ac114de5090e. service=AccessControlService 2023-07-21 20:10:47,109 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 20:10:47,109 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1689970246687.61ff8d76a4114ff2b666ca25e8c0f12f. service=AccessControlService 2023-07-21 20:10:47,109 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState e65a1ace54a369fb4144ac114de5090e 2023-07-21 20:10:47,110 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689970246687.e65a1ace54a369fb4144ac114de5090e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 20:10:47,110 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 20:10:47,110 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e65a1ace54a369fb4144ac114de5090e 2023-07-21 20:10:47,110 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e65a1ace54a369fb4144ac114de5090e 2023-07-21 20:10:47,110 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 61ff8d76a4114ff2b666ca25e8c0f12f 2023-07-21 20:10:47,110 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689970246687.61ff8d76a4114ff2b666ca25e8c0f12f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 20:10:47,110 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 61ff8d76a4114ff2b666ca25e8c0f12f 2023-07-21 20:10:47,110 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 61ff8d76a4114ff2b666ca25e8c0f12f 2023-07-21 20:10:47,111 INFO [StoreOpener-e65a1ace54a369fb4144ac114de5090e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region e65a1ace54a369fb4144ac114de5090e 2023-07-21 20:10:47,111 INFO [StoreOpener-61ff8d76a4114ff2b666ca25e8c0f12f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 61ff8d76a4114ff2b666ca25e8c0f12f 2023-07-21 20:10:47,113 DEBUG [StoreOpener-e65a1ace54a369fb4144ac114de5090e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testExportFileSystemState/e65a1ace54a369fb4144ac114de5090e/cf 2023-07-21 20:10:47,113 DEBUG [StoreOpener-e65a1ace54a369fb4144ac114de5090e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testExportFileSystemState/e65a1ace54a369fb4144ac114de5090e/cf 2023-07-21 20:10:47,113 DEBUG [StoreOpener-61ff8d76a4114ff2b666ca25e8c0f12f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testExportFileSystemState/61ff8d76a4114ff2b666ca25e8c0f12f/cf 2023-07-21 20:10:47,113 DEBUG [StoreOpener-61ff8d76a4114ff2b666ca25e8c0f12f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testExportFileSystemState/61ff8d76a4114ff2b666ca25e8c0f12f/cf 2023-07-21 20:10:47,114 INFO [StoreOpener-e65a1ace54a369fb4144ac114de5090e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e65a1ace54a369fb4144ac114de5090e columnFamilyName cf 2023-07-21 20:10:47,114 INFO [StoreOpener-61ff8d76a4114ff2b666ca25e8c0f12f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 61ff8d76a4114ff2b666ca25e8c0f12f columnFamilyName cf 2023-07-21 20:10:47,116 INFO [StoreOpener-e65a1ace54a369fb4144ac114de5090e-1] regionserver.HStore(310): Store=e65a1ace54a369fb4144ac114de5090e/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 20:10:47,117 INFO [StoreOpener-61ff8d76a4114ff2b666ca25e8c0f12f-1] regionserver.HStore(310): Store=61ff8d76a4114ff2b666ca25e8c0f12f/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 20:10:47,123 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testExportFileSystemState/e65a1ace54a369fb4144ac114de5090e 2023-07-21 20:10:47,123 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testExportFileSystemState/61ff8d76a4114ff2b666ca25e8c0f12f 2023-07-21 20:10:47,123 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testExportFileSystemState/e65a1ace54a369fb4144ac114de5090e 2023-07-21 20:10:47,123 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testExportFileSystemState/61ff8d76a4114ff2b666ca25e8c0f12f 2023-07-21 20:10:47,127 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 61ff8d76a4114ff2b666ca25e8c0f12f 2023-07-21 20:10:47,127 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e65a1ace54a369fb4144ac114de5090e 2023-07-21 20:10:47,130 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testExportFileSystemState/61ff8d76a4114ff2b666ca25e8c0f12f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-21 20:10:47,131 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 61ff8d76a4114ff2b666ca25e8c0f12f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70335120, jitterRate=0.048074960708618164}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-21 20:10:47,131 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testExportFileSystemState/e65a1ace54a369fb4144ac114de5090e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-21 20:10:47,131 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 61ff8d76a4114ff2b666ca25e8c0f12f: 2023-07-21 20:10:47,132 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e65a1ace54a369fb4144ac114de5090e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68869997, jitterRate=0.026242926716804504}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-21 20:10:47,132 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e65a1ace54a369fb4144ac114de5090e: 2023-07-21 20:10:47,132 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1689970246687.61ff8d76a4114ff2b666ca25e8c0f12f., pid=31, masterSystemTime=1689970247105 2023-07-21 20:10:47,133 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1689970246687.e65a1ace54a369fb4144ac114de5090e., pid=30, masterSystemTime=1689970247105 2023-07-21 20:10:47,135 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1689970246687.61ff8d76a4114ff2b666ca25e8c0f12f. 2023-07-21 20:10:47,135 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1689970246687.61ff8d76a4114ff2b666ca25e8c0f12f. 2023-07-21 20:10:47,135 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=61ff8d76a4114ff2b666ca25e8c0f12f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:10:47,136 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1689970246687.61ff8d76a4114ff2b666ca25e8c0f12f.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689970247135"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689970247135"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689970247135"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689970247135"}]},"ts":"1689970247135"} 2023-07-21 20:10:47,136 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1689970246687.e65a1ace54a369fb4144ac114de5090e. 2023-07-21 20:10:47,136 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1689970246687.e65a1ace54a369fb4144ac114de5090e. 2023-07-21 20:10:47,137 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=e65a1ace54a369fb4144ac114de5090e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:10:47,137 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1689970246687.e65a1ace54a369fb4144ac114de5090e.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689970247137"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689970247137"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689970247137"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689970247137"}]},"ts":"1689970247137"} 2023-07-21 20:10:47,142 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=28 2023-07-21 20:10:47,142 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=28, state=SUCCESS; OpenRegionProcedure 61ff8d76a4114ff2b666ca25e8c0f12f, server=jenkins-hbase4.apache.org,37823,1689970216018 in 185 msec 2023-07-21 20:10:47,143 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=29 2023-07-21 20:10:47,143 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=29, state=SUCCESS; OpenRegionProcedure e65a1ace54a369fb4144ac114de5090e, server=jenkins-hbase4.apache.org,40099,1689970215928 in 188 msec 2023-07-21 20:10:47,144 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=61ff8d76a4114ff2b666ca25e8c0f12f, ASSIGN in 350 msec 2023-07-21 20:10:47,146 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=27 2023-07-21 20:10:47,146 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=e65a1ace54a369fb4144ac114de5090e, ASSIGN in 351 msec 2023-07-21 20:10:47,147 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-21 20:10:47,147 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689970247147"}]},"ts":"1689970247147"} 2023-07-21 20:10:47,148 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-07-21 20:10:47,151 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-21 20:10:47,152 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-07-21 20:10:47,154 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37823] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-21 20:10:47,157 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 20:10:47,157 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 20:10:47,157 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 20:10:47,157 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 20:10:47,158 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-21 20:10:47,158 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-21 20:10:47,158 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-21 20:10:47,159 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-21 20:10:47,160 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 469 msec 2023-07-21 20:10:47,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-21 20:10:47,306 INFO [Listener at jenkins-hbase4.apache.org/38105] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-07-21 20:10:47,315 DEBUG [Listener at jenkins-hbase4.apache.org/38105] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-21 20:10:47,315 DEBUG [Listener at jenkins-hbase4.apache.org/38105] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1689970246687.61ff8d76a4114ff2b666ca25e8c0f12f. 2023-07-21 20:10:47,317 INFO [Listener at jenkins-hbase4.apache.org/38105] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-21 20:10:47,332 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-21 20:10:47,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689970247332 (current time:1689970247332). 2023-07-21 20:10:47,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-21 20:10:47,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] zookeeper.ReadOnlyZKClient(139): Connect 0x4ba95dcf to 127.0.0.1:59101 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 20:10:47,341 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@33f00b32, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 20:10:47,342 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 20:10:47,344 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55922, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 20:10:47,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4ba95dcf to 127.0.0.1:59101 2023-07-21 20:10:47,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 20:10:47,346 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] zookeeper.ReadOnlyZKClient(139): Connect 0x4d2737d8 to 127.0.0.1:59101 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 20:10:47,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4ce14c96, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 20:10:47,358 DEBUG [hconnection-0x7ffb77a3-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 20:10:47,362 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55932, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 20:10:47,367 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 20:10:47,369 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53032, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 20:10:47,370 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4d2737d8 to 127.0.0.1:59101 2023-07-21 20:10:47,370 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 20:10:47,370 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-21 20:10:47,371 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-21 20:10:47,372 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-21 20:10:47,374 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-21 20:10:47,375 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-21 20:10:47,376 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689970847376 2023-07-21 20:10:47,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-21 20:10:47,376 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-21 20:10:47,378 DEBUG [Listener at jenkins-hbase4.apache.org/38105] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-21 20:10:47,378 DEBUG [Listener at jenkins-hbase4.apache.org/38105] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-21 20:10:47,379 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-21 20:10:47,380 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-21 20:10:47,381 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-07-21 20:10:47,382 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-21 20:10:47,383 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689970847383 2023-07-21 20:10:47,401 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:47,401 INFO [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-07-21 20:10:47,401 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 20:10:47,403 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-07-21 20:10:47,403 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-21 20:10:47,404 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:47,404 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:47,405 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:10:47,405 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:10:47,405 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:10:47,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:10:47,405 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:10:47,405 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:10:47,406 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:10:47,406 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:10:47,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:10:47,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:10:47,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:47,406 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:10:47,406 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:10:47,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:47,406 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:47,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:47,407 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:10:47,407 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:47,407 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-21 20:10:47,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-21 20:10:47,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:47,407 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:47,407 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-21 20:10:47,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-21 20:10:47,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:47,407 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:47,407 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-21 20:10:47,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-21 20:10:47,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:47,407 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-21 20:10:47,408 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 20:10:47,408 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-21 20:10:47,408 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:47,409 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-21 20:10:47,409 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-21 20:10:47,409 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:47,409 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-21 20:10:47,409 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-21 20:10:47,409 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 20:10:47,409 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 20:10:47,410 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-21 20:10:47,412 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-21 20:10:47,412 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34071,1689970216065' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-21 20:10:47,409 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40099,1689970215928' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-21 20:10:47,412 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-21 20:10:47,412 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-21 20:10:47,412 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37823,1689970216018' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-21 20:10:47,415 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:10:47,415 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:47,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:10:47,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 20:10:47,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 20:10:47,418 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:47,418 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 20:10:47,418 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:10:47,418 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:47,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 20:10:47,420 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:47,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 20:10:47,420 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:47,420 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 20:10:47,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:47,420 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:47,420 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 20:10:47,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:10:47,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:10:47,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:10:47,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 20:10:47,423 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40099,1689970215928' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-21 20:10:47,423 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@143677e7[Count = 1] remaining members to acquire global barrier 2023-07-21 20:10:47,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:10:47,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 20:10:47,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 20:10:47,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 20:10:47,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 20:10:47,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:47,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:10:47,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:10:47,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:10:47,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 20:10:47,425 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37823,1689970216018' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-21 20:10:47,426 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@143677e7[Count = 0] remaining members to acquire global barrier 2023-07-21 20:10:47,426 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-21 20:10:47,426 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:47,428 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:47,428 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:47,428 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:47,428 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:47,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:47,428 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:47,428 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-21 20:10:47,429 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:10:47,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:47,429 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:47,429 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 20:10:47,429 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 20:10:47,429 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-21 20:10:47,429 DEBUG [rs(jenkins-hbase4.apache.org,40099,1689970215928)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689970246687.e65a1ace54a369fb4144ac114de5090e. 2023-07-21 20:10:47,429 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-21 20:10:47,429 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,34071,1689970216065' in zk 2023-07-21 20:10:47,429 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:10:47,429 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-21 20:10:47,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:47,430 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-21 20:10:47,430 DEBUG [rs(jenkins-hbase4.apache.org,40099,1689970215928)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689970246687.e65a1ace54a369fb4144ac114de5090e. started... 2023-07-21 20:10:47,430 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 20:10:47,436 DEBUG [rs(jenkins-hbase4.apache.org,37823,1689970216018)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689970246687.61ff8d76a4114ff2b666ca25e8c0f12f. 2023-07-21 20:10:47,436 DEBUG [rs(jenkins-hbase4.apache.org,37823,1689970216018)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689970246687.61ff8d76a4114ff2b666ca25e8c0f12f. started... 2023-07-21 20:10:47,436 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-21 20:10:47,436 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 20:10:47,436 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-21 20:10:47,436 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 20:10:47,436 DEBUG [rs(jenkins-hbase4.apache.org,37823,1689970216018)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 61ff8d76a4114ff2b666ca25e8c0f12f: 2023-07-21 20:10:47,436 DEBUG [rs(jenkins-hbase4.apache.org,40099,1689970215928)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e65a1ace54a369fb4144ac114de5090e: 2023-07-21 20:10:47,438 DEBUG [rs(jenkins-hbase4.apache.org,37823,1689970216018)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689970246687.61ff8d76a4114ff2b666ca25e8c0f12f.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:47,438 DEBUG [rs(jenkins-hbase4.apache.org,40099,1689970215928)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689970246687.e65a1ace54a369fb4144ac114de5090e.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:47,438 DEBUG [rs(jenkins-hbase4.apache.org,37823,1689970216018)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 20:10:47,438 DEBUG [rs(jenkins-hbase4.apache.org,40099,1689970215928)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 20:10:47,438 DEBUG [rs(jenkins-hbase4.apache.org,37823,1689970216018)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-21 20:10:47,438 DEBUG [rs(jenkins-hbase4.apache.org,40099,1689970215928)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-21 20:10:47,478 DEBUG [Listener at jenkins-hbase4.apache.org/38105] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 20:10:47,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-21 20:10:47,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-21 20:10:47,480 DEBUG [Listener at jenkins-hbase4.apache.org/38105] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-21 20:10:47,482 DEBUG [rs(jenkins-hbase4.apache.org,37823,1689970216018)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689970246687.61ff8d76a4114ff2b666ca25e8c0f12f. completed. 2023-07-21 20:10:47,482 DEBUG [rs(jenkins-hbase4.apache.org,37823,1689970216018)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689970246687.61ff8d76a4114ff2b666ca25e8c0f12f. 2023-07-21 20:10:47,482 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 20:10:47,482 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 20:10:47,482 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:10:47,482 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-21 20:10:47,483 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,37823,1689970216018' in zk 2023-07-21 20:10:47,484 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-21 20:10:47,484 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:10:47,484 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 20:10:47,484 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-21 20:10:47,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:10:47,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 20:10:47,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 20:10:47,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 20:10:47,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 20:10:47,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:47,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:10:47,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:10:47,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:10:47,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 20:10:47,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:47,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:10:47,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:10:47,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,37823,1689970216018': 2023-07-21 20:10:47,491 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37823,1689970216018' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-21 20:10:47,680 DEBUG [Listener at jenkins-hbase4.apache.org/38105] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 20:10:47,681 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-21 20:10:47,681 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-21 20:10:47,681 DEBUG [Listener at jenkins-hbase4.apache.org/38105] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-21 20:10:47,880 DEBUG [rs(jenkins-hbase4.apache.org,40099,1689970215928)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689970246687.e65a1ace54a369fb4144ac114de5090e. completed. 2023-07-21 20:10:47,880 DEBUG [rs(jenkins-hbase4.apache.org,40099,1689970215928)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689970246687.e65a1ace54a369fb4144ac114de5090e. 2023-07-21 20:10:47,880 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 20:10:47,880 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 20:10:47,880 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:10:47,880 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-21 20:10:47,880 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40099,1689970215928' in zk 2023-07-21 20:10:47,883 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-21 20:10:47,883 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:10:47,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:10:47,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 20:10:47,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 20:10:47,883 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 20:10:47,884 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-21 20:10:47,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 20:10:47,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 20:10:47,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:47,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:10:47,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:10:47,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:10:47,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 20:10:47,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:47,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:10:47,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:10:47,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:10:47,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,40099,1689970215928': 2023-07-21 20:10:47,889 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40099,1689970215928' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-21 20:10:47,889 INFO [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-07-21 20:10:47,889 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-21 20:10:47,889 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-21 20:10:47,889 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:47,889 INFO [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-21 20:10:47,891 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:47,891 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:47,891 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:10:47,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:47,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 20:10:47,891 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:47,891 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:47,891 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:47,891 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:10:47,892 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:47,891 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:10:47,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:47,891 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:47,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:47,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 20:10:47,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:47,892 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:10:47,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:10:47,892 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:10:47,892 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:10:47,892 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:10:47,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:10:47,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:10:47,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 20:10:47,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:47,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:47,893 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:10:47,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:47,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:47,893 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:10:47,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 20:10:47,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:47,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:10:47,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:10:47,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:10:47,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 20:10:47,895 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:10:47,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:47,896 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:10:47,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:10:47,896 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:10:47,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:10:47,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:10:47,899 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:10:47,899 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:10:47,899 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:47,899 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:10:47,899 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:10:47,899 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:10:47,899 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:10:47,899 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:10:47,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:10:47,899 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:10:47,899 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:47,899 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 20:10:47,899 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:10:47,899 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:10:47,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:10:47,901 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:10:47,899 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-07-21 20:10:47,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:10:47,899 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:10:47,901 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:47,901 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:10:47,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:10:47,901 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:47,901 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:10:47,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:10:47,901 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:10:47,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:10:47,901 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-21 20:10:47,901 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:10:47,902 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:47,902 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:10:47,902 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:10:47,902 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:47,902 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:47,902 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-21 20:10:47,912 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:47,913 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:47,938 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:47,968 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-21 20:10:47,968 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:47,968 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:47,969 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689970247377Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1689970247912 (+535 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1689970247912Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1689970247912Writing data manifest for emptySnaptb0-testExportFileSystemState at 1689970247917 (+5 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1689970247931 (+14 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689970247968 (+37 ms) 2023-07-21 20:10:47,972 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-21 20:10:47,974 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 594 msec 2023-07-21 20:10:47,982 DEBUG [Listener at jenkins-hbase4.apache.org/38105] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 20:10:47,983 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-21 20:10:47,983 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-21 20:10:47,986 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37823] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1689970246687.61ff8d76a4114ff2b666ca25e8c0f12f. with WAL disabled. Data may be lost in the event of a crash. 2023-07-21 20:10:47,988 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1689970246687.e65a1ace54a369fb4144ac114de5090e. with WAL disabled. Data may be lost in the event of a crash. 2023-07-21 20:10:47,994 DEBUG [Listener at jenkins-hbase4.apache.org/38105] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-21 20:10:47,995 DEBUG [Listener at jenkins-hbase4.apache.org/38105] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1689970246687.61ff8d76a4114ff2b666ca25e8c0f12f. 2023-07-21 20:10:47,995 INFO [Listener at jenkins-hbase4.apache.org/38105] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-21 20:10:48,008 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-21 20:10:48,008 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689970248008 (current time:1689970248008). 2023-07-21 20:10:48,008 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-21 20:10:48,009 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] zookeeper.ReadOnlyZKClient(139): Connect 0x34ab0209 to 127.0.0.1:59101 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 20:10:48,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2f57e308, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 20:10:48,017 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 20:10:48,021 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55936, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 20:10:48,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x34ab0209 to 127.0.0.1:59101 2023-07-21 20:10:48,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 20:10:48,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] zookeeper.ReadOnlyZKClient(139): Connect 0x72549613 to 127.0.0.1:59101 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 20:10:48,031 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@edc8661, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 20:10:48,032 DEBUG [hconnection-0x73c003b8-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 20:10:48,033 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55940, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 20:10:48,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 20:10:48,041 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53042, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 20:10:48,042 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x72549613 to 127.0.0.1:59101 2023-07-21 20:10:48,042 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 20:10:48,042 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-21 20:10:48,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-21 20:10:48,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-21 20:10:48,046 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-21 20:10:48,047 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-21 20:10:48,048 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689970848048 2023-07-21 20:10:48,048 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-21 20:10:48,048 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-21 20:10:48,050 DEBUG [Listener at jenkins-hbase4.apache.org/38105] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-21 20:10:48,050 DEBUG [Listener at jenkins-hbase4.apache.org/38105] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-21 20:10:48,051 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-21 20:10:48,051 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-21 20:10:48,053 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-07-21 20:10:48,054 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-21 20:10:48,055 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689970848055 2023-07-21 20:10:48,073 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-07-21 20:10:48,073 INFO [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-07-21 20:10:48,073 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 20:10:48,075 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-07-21 20:10:48,076 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-21 20:10:48,076 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-21 20:10:48,076 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-21 20:10:48,077 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:10:48,077 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:10:48,078 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:10:48,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:10:48,078 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:10:48,077 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:10:48,078 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:10:48,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:10:48,078 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:10:48,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-21 20:10:48,078 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:10:48,078 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:10:48,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:10:48,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-21 20:10:48,078 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-21 20:10:48,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-21 20:10:48,079 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-21 20:10:48,079 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:10:48,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-21 20:10:48,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-21 20:10:48,079 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-21 20:10:48,079 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-21 20:10:48,079 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-21 20:10:48,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-21 20:10:48,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-21 20:10:48,079 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-21 20:10:48,079 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-21 20:10:48,079 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-21 20:10:48,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-21 20:10:48,080 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-21 20:10:48,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-21 20:10:48,080 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-21 20:10:48,080 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 20:10:48,080 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-21 20:10:48,081 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-21 20:10:48,081 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-21 20:10:48,080 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 20:10:48,081 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37823,1689970216018' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-21 20:10:48,082 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-21 20:10:48,082 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-21 20:10:48,082 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34071,1689970216065' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-21 20:10:48,081 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-21 20:10:48,083 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-21 20:10:48,083 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 20:10:48,084 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-21 20:10:48,084 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-21 20:10:48,084 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40099,1689970215928' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-21 20:10:48,090 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:10:48,090 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-21 20:10:48,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:10:48,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 20:10:48,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 20:10:48,091 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-21 20:10:48,091 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:10:48,091 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-21 20:10:48,091 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 20:10:48,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 20:10:48,091 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-21 20:10:48,091 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-21 20:10:48,091 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 20:10:48,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 20:10:48,091 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-21 20:10:48,091 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 20:10:48,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-21 20:10:48,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:10:48,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:10:48,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:10:48,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 20:10:48,093 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37823,1689970216018' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-21 20:10:48,093 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@257204dd[Count = 1] remaining members to acquire global barrier 2023-07-21 20:10:48,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:10:48,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 20:10:48,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 20:10:48,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 20:10:48,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 20:10:48,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-21 20:10:48,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:10:48,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:10:48,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:10:48,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 20:10:48,096 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40099,1689970215928' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-21 20:10:48,096 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@257204dd[Count = 0] remaining members to acquire global barrier 2023-07-21 20:10:48,096 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-21 20:10:48,096 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-21 20:10:48,097 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-21 20:10:48,097 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-21 20:10:48,097 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-21 20:10:48,097 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-21 20:10:48,097 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-21 20:10:48,097 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-21 20:10:48,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-21 20:10:48,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-21 20:10:48,097 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:10:48,098 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-21 20:10:48,098 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-21 20:10:48,098 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,34071,1689970216065' in zk 2023-07-21 20:10:48,097 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-21 20:10:48,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-21 20:10:48,098 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:10:48,098 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-21 20:10:48,098 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 20:10:48,098 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-21 20:10:48,098 DEBUG [rs(jenkins-hbase4.apache.org,37823,1689970216018)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689970246687.61ff8d76a4114ff2b666ca25e8c0f12f. 2023-07-21 20:10:48,098 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 20:10:48,098 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 20:10:48,098 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 20:10:48,098 DEBUG [rs(jenkins-hbase4.apache.org,37823,1689970216018)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689970246687.61ff8d76a4114ff2b666ca25e8c0f12f. started... 2023-07-21 20:10:48,098 DEBUG [rs(jenkins-hbase4.apache.org,40099,1689970215928)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689970246687.e65a1ace54a369fb4144ac114de5090e. 2023-07-21 20:10:48,098 DEBUG [rs(jenkins-hbase4.apache.org,40099,1689970215928)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689970246687.e65a1ace54a369fb4144ac114de5090e. started... 2023-07-21 20:10:48,099 INFO [rs(jenkins-hbase4.apache.org,37823,1689970216018)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 61ff8d76a4114ff2b666ca25e8c0f12f 1/1 column families, dataSize=333 B heapSize=976 B 2023-07-21 20:10:48,099 INFO [rs(jenkins-hbase4.apache.org,40099,1689970215928)-snapshot-pool-0] regionserver.HRegion(2745): Flushing e65a1ace54a369fb4144ac114de5090e 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-07-21 20:10:48,099 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-21 20:10:48,099 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 20:10:48,099 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-21 20:10:48,136 INFO [rs(jenkins-hbase4.apache.org,37823,1689970216018)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023072129f5fffe5fcd4495a20d099cebe7d718 to hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e2023072129f5fffe5fcd4495a20d099cebe7d718 2023-07-21 20:10:48,139 INFO [rs(jenkins-hbase4.apache.org,40099,1689970215928)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230721eebca92108fd4c2cbc45c3fd25588535 to hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230721eebca92108fd4c2cbc45c3fd25588535 2023-07-21 20:10:48,150 DEBUG [Listener at jenkins-hbase4.apache.org/38105] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 20:10:48,154 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-21 20:10:48,154 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-21 20:10:48,154 DEBUG [Listener at jenkins-hbase4.apache.org/38105] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-21 20:10:48,158 INFO [rs(jenkins-hbase4.apache.org,37823,1689970216018)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testExportFileSystemState/61ff8d76a4114ff2b666ca25e8c0f12f/.tmp/cf/c67a1fb94e4346e5b3a5f58640e31d89 2023-07-21 20:10:48,167 DEBUG [rs(jenkins-hbase4.apache.org,37823,1689970216018)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testExportFileSystemState/61ff8d76a4114ff2b666ca25e8c0f12f/.tmp/cf/c67a1fb94e4346e5b3a5f58640e31d89 as hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testExportFileSystemState/61ff8d76a4114ff2b666ca25e8c0f12f/cf/c67a1fb94e4346e5b3a5f58640e31d89 2023-07-21 20:10:48,170 INFO [rs(jenkins-hbase4.apache.org,40099,1689970215928)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testExportFileSystemState/e65a1ace54a369fb4144ac114de5090e/.tmp/cf/eb00916054e94cbbaccdd5c0cbe0cd07 2023-07-21 20:10:48,174 INFO [rs(jenkins-hbase4.apache.org,37823,1689970216018)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testExportFileSystemState/61ff8d76a4114ff2b666ca25e8c0f12f/cf/c67a1fb94e4346e5b3a5f58640e31d89, entries=5, sequenceid=6, filesize=5.7 K 2023-07-21 20:10:48,176 INFO [rs(jenkins-hbase4.apache.org,37823,1689970216018)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for 61ff8d76a4114ff2b666ca25e8c0f12f in 77ms, sequenceid=6, compaction requested=false 2023-07-21 20:10:48,176 DEBUG [rs(jenkins-hbase4.apache.org,37823,1689970216018)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-07-21 20:10:48,176 DEBUG [rs(jenkins-hbase4.apache.org,37823,1689970216018)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 61ff8d76a4114ff2b666ca25e8c0f12f: 2023-07-21 20:10:48,177 DEBUG [rs(jenkins-hbase4.apache.org,37823,1689970216018)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689970246687.61ff8d76a4114ff2b666ca25e8c0f12f.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-21 20:10:48,177 DEBUG [rs(jenkins-hbase4.apache.org,37823,1689970216018)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 20:10:48,177 DEBUG [rs(jenkins-hbase4.apache.org,37823,1689970216018)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testExportFileSystemState/61ff8d76a4114ff2b666ca25e8c0f12f/cf/c67a1fb94e4346e5b3a5f58640e31d89] hfiles 2023-07-21 20:10:48,177 DEBUG [rs(jenkins-hbase4.apache.org,37823,1689970216018)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testExportFileSystemState/61ff8d76a4114ff2b666ca25e8c0f12f/cf/c67a1fb94e4346e5b3a5f58640e31d89 for snapshot=snaptb0-testExportFileSystemState 2023-07-21 20:10:48,181 DEBUG [rs(jenkins-hbase4.apache.org,40099,1689970215928)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testExportFileSystemState/e65a1ace54a369fb4144ac114de5090e/.tmp/cf/eb00916054e94cbbaccdd5c0cbe0cd07 as hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testExportFileSystemState/e65a1ace54a369fb4144ac114de5090e/cf/eb00916054e94cbbaccdd5c0cbe0cd07 2023-07-21 20:10:48,187 INFO [rs(jenkins-hbase4.apache.org,40099,1689970215928)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testExportFileSystemState/e65a1ace54a369fb4144ac114de5090e/cf/eb00916054e94cbbaccdd5c0cbe0cd07, entries=45, sequenceid=6, filesize=12.5 K 2023-07-21 20:10:48,188 INFO [rs(jenkins-hbase4.apache.org,40099,1689970215928)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for e65a1ace54a369fb4144ac114de5090e in 89ms, sequenceid=6, compaction requested=false 2023-07-21 20:10:48,196 DEBUG [rs(jenkins-hbase4.apache.org,40099,1689970215928)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e65a1ace54a369fb4144ac114de5090e: 2023-07-21 20:10:48,196 DEBUG [rs(jenkins-hbase4.apache.org,40099,1689970215928)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689970246687.e65a1ace54a369fb4144ac114de5090e.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-21 20:10:48,196 DEBUG [rs(jenkins-hbase4.apache.org,40099,1689970215928)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 20:10:48,197 DEBUG [rs(jenkins-hbase4.apache.org,40099,1689970215928)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testExportFileSystemState/e65a1ace54a369fb4144ac114de5090e/cf/eb00916054e94cbbaccdd5c0cbe0cd07] hfiles 2023-07-21 20:10:48,197 DEBUG [rs(jenkins-hbase4.apache.org,40099,1689970215928)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testExportFileSystemState/e65a1ace54a369fb4144ac114de5090e/cf/eb00916054e94cbbaccdd5c0cbe0cd07 for snapshot=snaptb0-testExportFileSystemState 2023-07-21 20:10:48,199 DEBUG [rs(jenkins-hbase4.apache.org,37823,1689970216018)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689970246687.61ff8d76a4114ff2b666ca25e8c0f12f. completed. 2023-07-21 20:10:48,199 DEBUG [rs(jenkins-hbase4.apache.org,37823,1689970216018)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689970246687.61ff8d76a4114ff2b666ca25e8c0f12f. 2023-07-21 20:10:48,199 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 20:10:48,199 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 20:10:48,200 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:10:48,200 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-21 20:10:48,200 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,37823,1689970216018' in zk 2023-07-21 20:10:48,206 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-21 20:10:48,206 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:10:48,206 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 20:10:48,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:10:48,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 20:10:48,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 20:10:48,206 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-21 20:10:48,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 20:10:48,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 20:10:48,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-21 20:10:48,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:10:48,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:10:48,211 DEBUG [rs(jenkins-hbase4.apache.org,40099,1689970215928)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689970246687.e65a1ace54a369fb4144ac114de5090e. completed. 2023-07-21 20:10:48,211 DEBUG [rs(jenkins-hbase4.apache.org,40099,1689970215928)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689970246687.e65a1ace54a369fb4144ac114de5090e. 2023-07-21 20:10:48,211 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 20:10:48,211 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 20:10:48,211 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:10:48,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:10:48,211 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-21 20:10:48,211 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40099,1689970215928' in zk 2023-07-21 20:10:48,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 20:10:48,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-21 20:10:48,214 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-21 20:10:48,214 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 20:10:48,214 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-21 20:10:48,216 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:10:48,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:10:48,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:10:48,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:10:48,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,37823,1689970216018': 2023-07-21 20:10:48,217 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37823,1689970216018' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-21 20:10:48,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:10:48,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 20:10:48,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 20:10:48,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 20:10:48,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 20:10:48,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-21 20:10:48,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:10:48,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:10:48,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:10:48,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 20:10:48,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-21 20:10:48,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:10:48,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:10:48,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:10:48,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,40099,1689970215928': 2023-07-21 20:10:48,221 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40099,1689970215928' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-21 20:10:48,221 INFO [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-07-21 20:10:48,221 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-21 20:10:48,221 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-21 20:10:48,221 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-07-21 20:10:48,221 INFO [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-21 20:10:48,223 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-21 20:10:48,223 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-21 20:10:48,223 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-21 20:10:48,223 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-21 20:10:48,223 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-21 20:10:48,223 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-21 20:10:48,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-21 20:10:48,223 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-21 20:10:48,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-21 20:10:48,223 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:10:48,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 20:10:48,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 20:10:48,223 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:10:48,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-21 20:10:48,223 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:10:48,223 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:10:48,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:10:48,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-21 20:10:48,224 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:10:48,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 20:10:48,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-21 20:10:48,224 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:10:48,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:10:48,224 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:10:48,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-21 20:10:48,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:10:48,224 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:10:48,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-21 20:10:48,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 20:10:48,225 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:10:48,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-21 20:10:48,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-21 20:10:48,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:10:48,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:10:48,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:10:48,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 20:10:48,227 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:10:48,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-21 20:10:48,227 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:10:48,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:10:48,227 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:10:48,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:10:48,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:10:48,232 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:10:48,232 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:10:48,232 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:10:48,232 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:10:48,232 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:10:48,233 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:10:48,233 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:10:48,233 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:10:48,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:10:48,233 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:10:48,232 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:10:48,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:10:48,232 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-21 20:10:48,233 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:10:48,233 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:10:48,233 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-21 20:10:48,233 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:10:48,233 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-21 20:10:48,233 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:10:48,233 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:10:48,233 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:10:48,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:10:48,233 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-07-21 20:10:48,233 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-07-21 20:10:48,234 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-21 20:10:48,234 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-21 20:10:48,233 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 20:10:48,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:10:48,233 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-21 20:10:48,233 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:10:48,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:10:48,236 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-21 20:10:48,236 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:10:48,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:10:48,236 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230721eebca92108fd4c2cbc45c3fd25588535, hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e2023072129f5fffe5fcd4495a20d099cebe7d718] mob files 2023-07-21 20:10:48,236 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230721eebca92108fd4c2cbc45c3fd25588535 2023-07-21 20:10:48,237 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e2023072129f5fffe5fcd4495a20d099cebe7d718 2023-07-21 20:10:48,249 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-07-21 20:10:48,250 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-21 20:10:48,275 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-21 20:10:48,306 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-21 20:10:48,306 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-21 20:10:48,307 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-21 20:10:48,307 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689970248048Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1689970248249 (+201 ms)Consolidate snapshot: snaptb0-testExportFileSystemState at 1689970248249Loading Region manifests for snaptb0-testExportFileSystemState at 1689970248250 (+1 ms)Writing data manifest for snaptb0-testExportFileSystemState at 1689970248254 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1689970248267 (+13 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689970248306 (+39 ms) 2023-07-21 20:10:48,309 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-21 20:10:48,312 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 259 msec 2023-07-21 20:10:48,354 DEBUG [Listener at jenkins-hbase4.apache.org/38105] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 20:10:48,355 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-21 20:10:48,356 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-21 20:10:48,356 INFO [Listener at jenkins-hbase4.apache.org/38105] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/export-test/export-1689970248356 2023-07-21 20:10:48,356 INFO [Listener at jenkins-hbase4.apache.org/38105] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:40641, tgtDir=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/export-test/export-1689970248356, rawTgtDir=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/export-test/export-1689970248356, srcFsUri=hdfs://localhost:40641, srcDir=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00 2023-07-21 20:10:48,379 DEBUG [Listener at jenkins-hbase4.apache.org/38105] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:40641, inputRoot=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00 2023-07-21 20:10:48,379 DEBUG [Listener at jenkins-hbase4.apache.org/38105] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1034665086_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/export-test/export-1689970248356, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/export-test/export-1689970248356/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-21 20:10:48,379 INFO [Listener at jenkins-hbase4.apache.org/38105] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:40641, inputRoot=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00, snapshotDir=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-07-21 20:10:48,389 INFO [Listener at jenkins-hbase4.apache.org/38105] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/export-test/export-1689970248356/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-21 20:10:48,820 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-21 20:10:48,820 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-21 20:10:48,821 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-21 20:10:48,821 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-21 20:10:49,835 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c4475fbf-6a12-c189-d7a2-889953ef4b74/hadoop-158724520893294785.jar 2023-07-21 20:10:49,835 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-21 20:10:49,836 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-21 20:10:49,905 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c4475fbf-6a12-c189-d7a2-889953ef4b74/hadoop-766274822782419309.jar 2023-07-21 20:10:49,905 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-21 20:10:49,906 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-21 20:10:49,906 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-21 20:10:49,907 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-21 20:10:49,908 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-21 20:10:49,908 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-21 20:10:49,909 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-21 20:10:49,909 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-21 20:10:49,910 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-21 20:10:49,910 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-21 20:10:49,910 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-21 20:10:49,911 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-21 20:10:49,911 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-21 20:10:49,911 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-21 20:10:49,912 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-21 20:10:49,912 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-21 20:10:49,913 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 20:10:49,913 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 20:10:49,914 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-21 20:10:49,914 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 20:10:49,914 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 20:10:49,915 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-21 20:10:49,916 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-21 20:10:50,562 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689970225203_0001_000001 (auth:SIMPLE) 2023-07-21 20:10:50,835 WARN [Listener at jenkins-hbase4.apache.org/38105] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-21 20:10:50,838 INFO [Listener at jenkins-hbase4.apache.org/38105] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-07-21 20:10:50,845 DEBUG [Listener at jenkins-hbase4.apache.org/38105] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-07-21 20:10:50,936 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-21 20:10:50,936 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-21 20:10:51,442 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689970225203_0002_000001 (auth:SIMPLE) 2023-07-21 20:10:51,919 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-21 20:10:56,201 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689970225203_0002_000001 (auth:SIMPLE) 2023-07-21 20:10:58,436 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689970225203_0002_000001 (auth:SIMPLE) 2023-07-21 20:11:01,486 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689970225203_0002_000001 (auth:SIMPLE) 2023-07-21 20:11:03,073 INFO [Listener at jenkins-hbase4.apache.org/38105] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-21 20:11:03,081 INFO [Listener at jenkins-hbase4.apache.org/38105] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-21 20:11:03,102 INFO [Listener at jenkins-hbase4.apache.org/38105] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-07-21 20:11:03,102 INFO [Listener at jenkins-hbase4.apache.org/38105] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-21 20:11:03,103 INFO [Listener at jenkins-hbase4.apache.org/38105] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-21 20:11:03,103 DEBUG [Listener at jenkins-hbase4.apache.org/38105] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_895530006_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-21 20:11:03,104 DEBUG [Listener at jenkins-hbase4.apache.org/38105] snapshot.TestExportSnapshot(367): hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-21 20:11:03,104 DEBUG [Listener at jenkins-hbase4.apache.org/38105] snapshot.TestExportSnapshot(367): hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-21 20:11:03,104 DEBUG [Listener at jenkins-hbase4.apache.org/38105] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_895530006_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/export-test/export-1689970248356/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/export-test/export-1689970248356/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-21 20:11:03,105 DEBUG [Listener at jenkins-hbase4.apache.org/38105] snapshot.TestExportSnapshot(367): hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/export-test/export-1689970248356/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-21 20:11:03,105 DEBUG [Listener at jenkins-hbase4.apache.org/38105] snapshot.TestExportSnapshot(367): hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/export-test/export-1689970248356/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-21 20:11:03,124 INFO [Listener at jenkins-hbase4.apache.org/38105] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-07-21 20:11:03,124 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-07-21 20:11:03,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] procedure2.ProcedureExecutor(1029): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-07-21 20:11:03,133 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-21 20:11:03,136 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689970263136"}]},"ts":"1689970263136"} 2023-07-21 20:11:03,138 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-07-21 20:11:03,140 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-07-21 20:11:03,142 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=61ff8d76a4114ff2b666ca25e8c0f12f, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=e65a1ace54a369fb4144ac114de5090e, UNASSIGN}] 2023-07-21 20:11:03,145 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=e65a1ace54a369fb4144ac114de5090e, UNASSIGN 2023-07-21 20:11:03,145 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=61ff8d76a4114ff2b666ca25e8c0f12f, UNASSIGN 2023-07-21 20:11:03,146 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=e65a1ace54a369fb4144ac114de5090e, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:11:03,146 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=61ff8d76a4114ff2b666ca25e8c0f12f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:11:03,146 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689970246687.e65a1ace54a369fb4144ac114de5090e.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689970263146"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689970263146"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689970263146"}]},"ts":"1689970263146"} 2023-07-21 20:11:03,146 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689970246687.61ff8d76a4114ff2b666ca25e8c0f12f.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689970263146"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689970263146"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689970263146"}]},"ts":"1689970263146"} 2023-07-21 20:11:03,148 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=39, ppid=38, state=RUNNABLE; CloseRegionProcedure e65a1ace54a369fb4144ac114de5090e, server=jenkins-hbase4.apache.org,40099,1689970215928}] 2023-07-21 20:11:03,149 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=37, state=RUNNABLE; CloseRegionProcedure 61ff8d76a4114ff2b666ca25e8c0f12f, server=jenkins-hbase4.apache.org,37823,1689970216018}] 2023-07-21 20:11:03,234 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-21 20:11:03,300 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close e65a1ace54a369fb4144ac114de5090e 2023-07-21 20:11:03,301 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e65a1ace54a369fb4144ac114de5090e, disabling compactions & flushes 2023-07-21 20:11:03,301 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689970246687.e65a1ace54a369fb4144ac114de5090e. 2023-07-21 20:11:03,301 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689970246687.e65a1ace54a369fb4144ac114de5090e. 2023-07-21 20:11:03,301 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689970246687.e65a1ace54a369fb4144ac114de5090e. after waiting 0 ms 2023-07-21 20:11:03,301 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689970246687.e65a1ace54a369fb4144ac114de5090e. 2023-07-21 20:11:03,304 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 61ff8d76a4114ff2b666ca25e8c0f12f 2023-07-21 20:11:03,305 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 61ff8d76a4114ff2b666ca25e8c0f12f, disabling compactions & flushes 2023-07-21 20:11:03,305 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689970246687.61ff8d76a4114ff2b666ca25e8c0f12f. 2023-07-21 20:11:03,305 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689970246687.61ff8d76a4114ff2b666ca25e8c0f12f. 2023-07-21 20:11:03,305 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689970246687.61ff8d76a4114ff2b666ca25e8c0f12f. after waiting 0 ms 2023-07-21 20:11:03,305 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689970246687.61ff8d76a4114ff2b666ca25e8c0f12f. 2023-07-21 20:11:03,325 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testExportFileSystemState/e65a1ace54a369fb4144ac114de5090e/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-21 20:11:03,326 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testExportFileSystemState/61ff8d76a4114ff2b666ca25e8c0f12f/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-21 20:11:03,326 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 20:11:03,327 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689970246687.e65a1ace54a369fb4144ac114de5090e. 2023-07-21 20:11:03,327 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e65a1ace54a369fb4144ac114de5090e: 2023-07-21 20:11:03,328 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 20:11:03,329 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689970246687.61ff8d76a4114ff2b666ca25e8c0f12f. 2023-07-21 20:11:03,329 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 61ff8d76a4114ff2b666ca25e8c0f12f: 2023-07-21 20:11:03,330 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed e65a1ace54a369fb4144ac114de5090e 2023-07-21 20:11:03,331 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=e65a1ace54a369fb4144ac114de5090e, regionState=CLOSED 2023-07-21 20:11:03,331 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689970246687.e65a1ace54a369fb4144ac114de5090e.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689970263331"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689970263331"}]},"ts":"1689970263331"} 2023-07-21 20:11:03,332 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 61ff8d76a4114ff2b666ca25e8c0f12f 2023-07-21 20:11:03,333 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=61ff8d76a4114ff2b666ca25e8c0f12f, regionState=CLOSED 2023-07-21 20:11:03,333 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689970246687.61ff8d76a4114ff2b666ca25e8c0f12f.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689970263332"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689970263332"}]},"ts":"1689970263332"} 2023-07-21 20:11:03,336 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=39, resume processing ppid=38 2023-07-21 20:11:03,336 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=38, state=SUCCESS; CloseRegionProcedure e65a1ace54a369fb4144ac114de5090e, server=jenkins-hbase4.apache.org,40099,1689970215928 in 185 msec 2023-07-21 20:11:03,339 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=37 2023-07-21 20:11:03,339 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=37, state=SUCCESS; CloseRegionProcedure 61ff8d76a4114ff2b666ca25e8c0f12f, server=jenkins-hbase4.apache.org,37823,1689970216018 in 185 msec 2023-07-21 20:11:03,339 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=e65a1ace54a369fb4144ac114de5090e, UNASSIGN in 194 msec 2023-07-21 20:11:03,341 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=37, resume processing ppid=36 2023-07-21 20:11:03,341 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=61ff8d76a4114ff2b666ca25e8c0f12f, UNASSIGN in 197 msec 2023-07-21 20:11:03,342 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689970263342"}]},"ts":"1689970263342"} 2023-07-21 20:11:03,343 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-07-21 20:11:03,345 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-07-21 20:11:03,348 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 221 msec 2023-07-21 20:11:03,435 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-21 20:11:03,436 INFO [Listener at jenkins-hbase4.apache.org/38105] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-07-21 20:11:03,437 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-07-21 20:11:03,438 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] procedure2.ProcedureExecutor(1029): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-21 20:11:03,440 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-21 20:11:03,440 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-07-21 20:11:03,441 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-21 20:11:03,443 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37823] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-07-21 20:11:03,446 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-21 20:11:03,446 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-21 20:11:03,446 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-21 20:11:03,446 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-21 20:11:03,446 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-21 20:11:03,447 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-21 20:11:03,447 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-21 20:11:03,447 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-21 20:11:03,448 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testExportFileSystemState/61ff8d76a4114ff2b666ca25e8c0f12f 2023-07-21 20:11:03,448 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testExportFileSystemState/e65a1ace54a369fb4144ac114de5090e 2023-07-21 20:11:03,449 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-21 20:11:03,449 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 20:11:03,449 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-21 20:11:03,449 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 20:11:03,450 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-21 20:11:03,450 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 20:11:03,450 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-21 20:11:03,451 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 20:11:03,451 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testExportFileSystemState/e65a1ace54a369fb4144ac114de5090e/cf, FileablePath, hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testExportFileSystemState/e65a1ace54a369fb4144ac114de5090e/recovered.edits] 2023-07-21 20:11:03,452 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-21 20:11:03,452 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testExportFileSystemState/61ff8d76a4114ff2b666ca25e8c0f12f/cf, FileablePath, hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testExportFileSystemState/61ff8d76a4114ff2b666ca25e8c0f12f/recovered.edits] 2023-07-21 20:11:03,460 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testExportFileSystemState/e65a1ace54a369fb4144ac114de5090e/cf/eb00916054e94cbbaccdd5c0cbe0cd07 to hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/archive/data/default/testtb-testExportFileSystemState/e65a1ace54a369fb4144ac114de5090e/cf/eb00916054e94cbbaccdd5c0cbe0cd07 2023-07-21 20:11:03,461 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testExportFileSystemState/61ff8d76a4114ff2b666ca25e8c0f12f/cf/c67a1fb94e4346e5b3a5f58640e31d89 to hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/archive/data/default/testtb-testExportFileSystemState/61ff8d76a4114ff2b666ca25e8c0f12f/cf/c67a1fb94e4346e5b3a5f58640e31d89 2023-07-21 20:11:03,481 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testExportFileSystemState/61ff8d76a4114ff2b666ca25e8c0f12f/recovered.edits/9.seqid to hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/archive/data/default/testtb-testExportFileSystemState/61ff8d76a4114ff2b666ca25e8c0f12f/recovered.edits/9.seqid 2023-07-21 20:11:03,483 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testExportFileSystemState/e65a1ace54a369fb4144ac114de5090e/recovered.edits/9.seqid to hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/archive/data/default/testtb-testExportFileSystemState/e65a1ace54a369fb4144ac114de5090e/recovered.edits/9.seqid 2023-07-21 20:11:03,483 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testExportFileSystemState/61ff8d76a4114ff2b666ca25e8c0f12f 2023-07-21 20:11:03,485 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testExportFileSystemState/e65a1ace54a369fb4144ac114de5090e 2023-07-21 20:11:03,485 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-21 20:11:03,486 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-07-21 20:11:03,488 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf] 2023-07-21 20:11:03,494 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230721eebca92108fd4c2cbc45c3fd25588535 to hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230721eebca92108fd4c2cbc45c3fd25588535 2023-07-21 20:11:03,496 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e2023072129f5fffe5fcd4495a20d099cebe7d718 to hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e2023072129f5fffe5fcd4495a20d099cebe7d718 2023-07-21 20:11:03,496 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-07-21 20:11:03,501 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-21 20:11:03,519 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-07-21 20:11:03,524 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-07-21 20:11:03,527 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-21 20:11:03,527 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-07-21 20:11:03,527 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1689970246687.61ff8d76a4114ff2b666ca25e8c0f12f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689970263527"}]},"ts":"9223372036854775807"} 2023-07-21 20:11:03,527 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1689970246687.e65a1ace54a369fb4144ac114de5090e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689970263527"}]},"ts":"9223372036854775807"} 2023-07-21 20:11:03,549 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-21 20:11:03,550 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 61ff8d76a4114ff2b666ca25e8c0f12f, NAME => 'testtb-testExportFileSystemState,,1689970246687.61ff8d76a4114ff2b666ca25e8c0f12f.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => e65a1ace54a369fb4144ac114de5090e, NAME => 'testtb-testExportFileSystemState,1,1689970246687.e65a1ace54a369fb4144ac114de5090e.', STARTKEY => '1', ENDKEY => ''}] 2023-07-21 20:11:03,550 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-07-21 20:11:03,550 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689970263550"}]},"ts":"9223372036854775807"} 2023-07-21 20:11:03,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-21 20:11:03,565 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-07-21 20:11:03,568 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-21 20:11:03,570 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 131 msec 2023-07-21 20:11:03,756 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-21 20:11:03,756 INFO [Listener at jenkins-hbase4.apache.org/38105] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-07-21 20:11:03,765 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-07-21 20:11:03,767 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-07-21 20:11:03,768 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-07-21 20:11:03,771 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-07-21 20:11:03,802 INFO [Listener at jenkins-hbase4.apache.org/38105] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=761 (was 752) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_895530006_17 at /127.0.0.1:47168 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-2026 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3e3f9760-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3e3f9760-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1354340851) connection to jenkins-hbase4.apache.org/172.31.14.131:43751 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x3e3f9760-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3e3f9760-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_895530006_17 at /127.0.0.1:43298 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_895530006_17 at /127.0.0.1:57272 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-573994083_1 at /127.0.0.1:57240 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=922 (was 918) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=298 (was 350), ProcessCount=185 (was 185), AvailableMemoryMB=7411 (was 7667) 2023-07-21 20:11:03,802 WARN [Listener at jenkins-hbase4.apache.org/38105] hbase.ResourceChecker(130): Thread=761 is superior to 500 2023-07-21 20:11:03,826 INFO [Listener at jenkins-hbase4.apache.org/38105] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=761, OpenFileDescriptor=922, MaxFileDescriptor=60000, SystemLoadAverage=298, ProcessCount=185, AvailableMemoryMB=7409 2023-07-21 20:11:03,826 WARN [Listener at jenkins-hbase4.apache.org/38105] hbase.ResourceChecker(130): Thread=761 is superior to 500 2023-07-21 20:11:03,828 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-21 20:11:03,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-07-21 20:11:03,833 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-07-21 20:11:03,833 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-07-21 20:11:03,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-21 20:11:03,836 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-21 20:11:03,839 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testConsecutiveExports/7226df4663cd91f52a160159751a75c1 2023-07-21 20:11:03,839 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testConsecutiveExports/26be4fd56ecb17c012a1fea3866c5c1b 2023-07-21 20:11:03,840 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testConsecutiveExports/26be4fd56ecb17c012a1fea3866c5c1b empty. 2023-07-21 20:11:03,840 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testConsecutiveExports/7226df4663cd91f52a160159751a75c1 empty. 2023-07-21 20:11:03,840 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testConsecutiveExports/26be4fd56ecb17c012a1fea3866c5c1b 2023-07-21 20:11:03,840 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testConsecutiveExports/7226df4663cd91f52a160159751a75c1 2023-07-21 20:11:03,840 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-21 20:11:03,868 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-07-21 20:11:03,870 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => 7226df4663cd91f52a160159751a75c1, NAME => 'testtb-testConsecutiveExports,,1689970263828.7226df4663cd91f52a160159751a75c1.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp 2023-07-21 20:11:03,870 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => 26be4fd56ecb17c012a1fea3866c5c1b, NAME => 'testtb-testConsecutiveExports,1,1689970263828.26be4fd56ecb17c012a1fea3866c5c1b.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp 2023-07-21 20:11:03,903 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689970263828.7226df4663cd91f52a160159751a75c1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 20:11:03,903 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689970263828.26be4fd56ecb17c012a1fea3866c5c1b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 20:11:03,903 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing 7226df4663cd91f52a160159751a75c1, disabling compactions & flushes 2023-07-21 20:11:03,903 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing 26be4fd56ecb17c012a1fea3866c5c1b, disabling compactions & flushes 2023-07-21 20:11:03,903 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689970263828.7226df4663cd91f52a160159751a75c1. 2023-07-21 20:11:03,903 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689970263828.26be4fd56ecb17c012a1fea3866c5c1b. 2023-07-21 20:11:03,903 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689970263828.7226df4663cd91f52a160159751a75c1. 2023-07-21 20:11:03,903 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689970263828.26be4fd56ecb17c012a1fea3866c5c1b. 2023-07-21 20:11:03,903 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689970263828.7226df4663cd91f52a160159751a75c1. after waiting 0 ms 2023-07-21 20:11:03,903 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689970263828.26be4fd56ecb17c012a1fea3866c5c1b. after waiting 0 ms 2023-07-21 20:11:03,903 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689970263828.7226df4663cd91f52a160159751a75c1. 2023-07-21 20:11:03,903 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689970263828.26be4fd56ecb17c012a1fea3866c5c1b. 2023-07-21 20:11:03,903 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689970263828.7226df4663cd91f52a160159751a75c1. 2023-07-21 20:11:03,903 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689970263828.26be4fd56ecb17c012a1fea3866c5c1b. 2023-07-21 20:11:03,903 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for 7226df4663cd91f52a160159751a75c1: 2023-07-21 20:11:03,903 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for 26be4fd56ecb17c012a1fea3866c5c1b: 2023-07-21 20:11:03,907 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-07-21 20:11:03,908 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689970263828.7226df4663cd91f52a160159751a75c1.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689970263907"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689970263907"}]},"ts":"1689970263907"} 2023-07-21 20:11:03,908 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689970263828.26be4fd56ecb17c012a1fea3866c5c1b.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689970263907"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689970263907"}]},"ts":"1689970263907"} 2023-07-21 20:11:03,910 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-21 20:11:03,912 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-21 20:11:03,912 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689970263912"}]},"ts":"1689970263912"} 2023-07-21 20:11:03,913 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-07-21 20:11:03,916 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-21 20:11:03,918 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-21 20:11:03,918 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-21 20:11:03,918 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-21 20:11:03,918 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-21 20:11:03,918 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=7226df4663cd91f52a160159751a75c1, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=26be4fd56ecb17c012a1fea3866c5c1b, ASSIGN}] 2023-07-21 20:11:03,921 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=26be4fd56ecb17c012a1fea3866c5c1b, ASSIGN 2023-07-21 20:11:03,921 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=7226df4663cd91f52a160159751a75c1, ASSIGN 2023-07-21 20:11:03,923 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=26be4fd56ecb17c012a1fea3866c5c1b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37823,1689970216018; forceNewPlan=false, retain=false 2023-07-21 20:11:03,923 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=7226df4663cd91f52a160159751a75c1, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34071,1689970216065; forceNewPlan=false, retain=false 2023-07-21 20:11:03,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-21 20:11:04,073 INFO [jenkins-hbase4:41777] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-21 20:11:04,076 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=7226df4663cd91f52a160159751a75c1, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:11:04,076 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=26be4fd56ecb17c012a1fea3866c5c1b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:11:04,076 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689970263828.7226df4663cd91f52a160159751a75c1.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689970264076"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689970264076"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689970264076"}]},"ts":"1689970264076"} 2023-07-21 20:11:04,076 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689970263828.26be4fd56ecb17c012a1fea3866c5c1b.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689970264076"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689970264076"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689970264076"}]},"ts":"1689970264076"} 2023-07-21 20:11:04,079 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=43, state=RUNNABLE; OpenRegionProcedure 7226df4663cd91f52a160159751a75c1, server=jenkins-hbase4.apache.org,34071,1689970216065}] 2023-07-21 20:11:04,080 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=44, state=RUNNABLE; OpenRegionProcedure 26be4fd56ecb17c012a1fea3866c5c1b, server=jenkins-hbase4.apache.org,37823,1689970216018}] 2023-07-21 20:11:04,137 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-21 20:11:04,241 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1689970263828.26be4fd56ecb17c012a1fea3866c5c1b. 2023-07-21 20:11:04,241 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1689970263828.7226df4663cd91f52a160159751a75c1. 2023-07-21 20:11:04,241 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 26be4fd56ecb17c012a1fea3866c5c1b, NAME => 'testtb-testConsecutiveExports,1,1689970263828.26be4fd56ecb17c012a1fea3866c5c1b.', STARTKEY => '1', ENDKEY => ''} 2023-07-21 20:11:04,242 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7226df4663cd91f52a160159751a75c1, NAME => 'testtb-testConsecutiveExports,,1689970263828.7226df4663cd91f52a160159751a75c1.', STARTKEY => '', ENDKEY => '1'} 2023-07-21 20:11:04,242 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1689970263828.26be4fd56ecb17c012a1fea3866c5c1b. service=AccessControlService 2023-07-21 20:11:04,242 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1689970263828.7226df4663cd91f52a160159751a75c1. service=AccessControlService 2023-07-21 20:11:04,242 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 20:11:04,242 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 26be4fd56ecb17c012a1fea3866c5c1b 2023-07-21 20:11:04,242 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 20:11:04,242 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689970263828.26be4fd56ecb17c012a1fea3866c5c1b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 20:11:04,242 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 26be4fd56ecb17c012a1fea3866c5c1b 2023-07-21 20:11:04,242 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 26be4fd56ecb17c012a1fea3866c5c1b 2023-07-21 20:11:04,242 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 7226df4663cd91f52a160159751a75c1 2023-07-21 20:11:04,243 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689970263828.7226df4663cd91f52a160159751a75c1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 20:11:04,243 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 7226df4663cd91f52a160159751a75c1 2023-07-21 20:11:04,243 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 7226df4663cd91f52a160159751a75c1 2023-07-21 20:11:04,245 INFO [StoreOpener-26be4fd56ecb17c012a1fea3866c5c1b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 26be4fd56ecb17c012a1fea3866c5c1b 2023-07-21 20:11:04,246 INFO [StoreOpener-7226df4663cd91f52a160159751a75c1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 7226df4663cd91f52a160159751a75c1 2023-07-21 20:11:04,247 DEBUG [StoreOpener-7226df4663cd91f52a160159751a75c1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testConsecutiveExports/7226df4663cd91f52a160159751a75c1/cf 2023-07-21 20:11:04,247 DEBUG [StoreOpener-7226df4663cd91f52a160159751a75c1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testConsecutiveExports/7226df4663cd91f52a160159751a75c1/cf 2023-07-21 20:11:04,248 INFO [StoreOpener-7226df4663cd91f52a160159751a75c1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7226df4663cd91f52a160159751a75c1 columnFamilyName cf 2023-07-21 20:11:04,249 INFO [StoreOpener-7226df4663cd91f52a160159751a75c1-1] regionserver.HStore(310): Store=7226df4663cd91f52a160159751a75c1/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 20:11:04,250 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testConsecutiveExports/7226df4663cd91f52a160159751a75c1 2023-07-21 20:11:04,250 DEBUG [StoreOpener-26be4fd56ecb17c012a1fea3866c5c1b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testConsecutiveExports/26be4fd56ecb17c012a1fea3866c5c1b/cf 2023-07-21 20:11:04,250 DEBUG [StoreOpener-26be4fd56ecb17c012a1fea3866c5c1b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testConsecutiveExports/26be4fd56ecb17c012a1fea3866c5c1b/cf 2023-07-21 20:11:04,251 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testConsecutiveExports/7226df4663cd91f52a160159751a75c1 2023-07-21 20:11:04,251 INFO [StoreOpener-26be4fd56ecb17c012a1fea3866c5c1b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 26be4fd56ecb17c012a1fea3866c5c1b columnFamilyName cf 2023-07-21 20:11:04,252 INFO [StoreOpener-26be4fd56ecb17c012a1fea3866c5c1b-1] regionserver.HStore(310): Store=26be4fd56ecb17c012a1fea3866c5c1b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 20:11:04,253 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testConsecutiveExports/26be4fd56ecb17c012a1fea3866c5c1b 2023-07-21 20:11:04,254 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testConsecutiveExports/26be4fd56ecb17c012a1fea3866c5c1b 2023-07-21 20:11:04,254 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 7226df4663cd91f52a160159751a75c1 2023-07-21 20:11:04,256 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testConsecutiveExports/7226df4663cd91f52a160159751a75c1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-21 20:11:04,256 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 26be4fd56ecb17c012a1fea3866c5c1b 2023-07-21 20:11:04,257 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 7226df4663cd91f52a160159751a75c1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69347097, jitterRate=0.03335227072238922}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-21 20:11:04,257 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 7226df4663cd91f52a160159751a75c1: 2023-07-21 20:11:04,258 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1689970263828.7226df4663cd91f52a160159751a75c1., pid=45, masterSystemTime=1689970264232 2023-07-21 20:11:04,259 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testConsecutiveExports/26be4fd56ecb17c012a1fea3866c5c1b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-21 20:11:04,259 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 26be4fd56ecb17c012a1fea3866c5c1b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62331741, jitterRate=-0.0711846798658371}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-21 20:11:04,259 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 26be4fd56ecb17c012a1fea3866c5c1b: 2023-07-21 20:11:04,260 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1689970263828.7226df4663cd91f52a160159751a75c1. 2023-07-21 20:11:04,260 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1689970263828.7226df4663cd91f52a160159751a75c1. 2023-07-21 20:11:04,260 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1689970263828.26be4fd56ecb17c012a1fea3866c5c1b., pid=46, masterSystemTime=1689970264232 2023-07-21 20:11:04,261 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=7226df4663cd91f52a160159751a75c1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:11:04,261 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1689970263828.7226df4663cd91f52a160159751a75c1.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689970264261"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689970264261"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689970264261"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689970264261"}]},"ts":"1689970264261"} 2023-07-21 20:11:04,262 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1689970263828.26be4fd56ecb17c012a1fea3866c5c1b. 2023-07-21 20:11:04,262 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1689970263828.26be4fd56ecb17c012a1fea3866c5c1b. 2023-07-21 20:11:04,263 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=26be4fd56ecb17c012a1fea3866c5c1b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:11:04,263 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1689970263828.26be4fd56ecb17c012a1fea3866c5c1b.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689970264263"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689970264263"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689970264263"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689970264263"}]},"ts":"1689970264263"} 2023-07-21 20:11:04,266 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=43 2023-07-21 20:11:04,266 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=43, state=SUCCESS; OpenRegionProcedure 7226df4663cd91f52a160159751a75c1, server=jenkins-hbase4.apache.org,34071,1689970216065 in 184 msec 2023-07-21 20:11:04,268 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=44 2023-07-21 20:11:04,268 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=44, state=SUCCESS; OpenRegionProcedure 26be4fd56ecb17c012a1fea3866c5c1b, server=jenkins-hbase4.apache.org,37823,1689970216018 in 185 msec 2023-07-21 20:11:04,268 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=7226df4663cd91f52a160159751a75c1, ASSIGN in 348 msec 2023-07-21 20:11:04,270 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=42 2023-07-21 20:11:04,270 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=26be4fd56ecb17c012a1fea3866c5c1b, ASSIGN in 350 msec 2023-07-21 20:11:04,271 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-21 20:11:04,271 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689970264271"}]},"ts":"1689970264271"} 2023-07-21 20:11:04,273 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-07-21 20:11:04,275 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-07-21 20:11:04,276 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-07-21 20:11:04,278 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37823] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-21 20:11:04,280 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 20:11:04,280 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 20:11:04,280 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 20:11:04,280 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 20:11:04,282 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-21 20:11:04,282 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-21 20:11:04,282 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-21 20:11:04,283 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-21 20:11:04,285 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 454 msec 2023-07-21 20:11:04,438 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-21 20:11:04,439 INFO [Listener at jenkins-hbase4.apache.org/38105] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-07-21 20:11:04,441 DEBUG [Listener at jenkins-hbase4.apache.org/38105] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-21 20:11:04,442 DEBUG [Listener at jenkins-hbase4.apache.org/38105] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1689970263828.7226df4663cd91f52a160159751a75c1. 2023-07-21 20:11:04,444 INFO [Listener at jenkins-hbase4.apache.org/38105] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-21 20:11:04,453 DEBUG [hconnection-0x5dbe67be-shared-pool-16] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 20:11:04,459 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52678, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 20:11:04,466 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-21 20:11:04,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689970264466 (current time:1689970264466). 2023-07-21 20:11:04,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-21 20:11:04,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] zookeeper.ReadOnlyZKClient(139): Connect 0x4d087963 to 127.0.0.1:59101 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 20:11:04,473 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5976f1d0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 20:11:04,474 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 20:11:04,477 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49772, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 20:11:04,478 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4d087963 to 127.0.0.1:59101 2023-07-21 20:11:04,478 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 20:11:04,478 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] zookeeper.ReadOnlyZKClient(139): Connect 0x08681363 to 127.0.0.1:59101 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 20:11:04,485 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@625b06c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 20:11:04,487 DEBUG [hconnection-0x68b32909-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 20:11:04,490 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49788, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 20:11:04,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 20:11:04,496 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42400, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 20:11:04,497 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x08681363 to 127.0.0.1:59101 2023-07-21 20:11:04,498 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 20:11:04,498 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-21 20:11:04,499 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-21 20:11:04,499 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-21 20:11:04,501 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] procedure2.ProcedureExecutor(1029): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-21 20:11:04,503 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-21 20:11:04,504 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689970864504 2023-07-21 20:11:04,504 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-21 20:11:04,504 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-21 20:11:04,505 DEBUG [Listener at jenkins-hbase4.apache.org/38105] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-21 20:11:04,505 DEBUG [Listener at jenkins-hbase4.apache.org/38105] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-21 20:11:04,507 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-21 20:11:04,507 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-21 20:11:04,508 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 7 msec 2023-07-21 20:11:04,509 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-21 20:11:04,510 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689970864510 2023-07-21 20:11:04,521 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:04,521 INFO [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-07-21 20:11:04,521 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 20:11:04,523 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-07-21 20:11:04,523 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-21 20:11:04,523 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:04,523 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:04,525 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:11:04,525 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:11:04,525 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:11:04,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:11:04,525 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:11:04,525 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:11:04,525 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:11:04,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:11:04,525 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:11:04,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:11:04,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:04,525 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:11:04,525 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:11:04,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:04,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:04,526 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:04,526 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:11:04,526 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:04,526 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-21 20:11:04,526 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:04,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-21 20:11:04,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:04,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-21 20:11:04,526 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-21 20:11:04,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:04,527 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-21 20:11:04,527 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:04,527 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-21 20:11:04,527 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:04,527 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 20:11:04,527 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-21 20:11:04,529 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 20:11:04,529 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-21 20:11:04,530 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-21 20:11:04,530 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-21 20:11:04,530 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34071,1689970216065' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-21 20:11:04,530 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-21 20:11:04,530 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40099,1689970215928' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-21 20:11:04,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-21 20:11:04,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:04,531 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-21 20:11:04,531 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:04,531 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-21 20:11:04,531 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 20:11:04,535 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-21 20:11:04,535 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-21 20:11:04,535 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37823,1689970216018' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-21 20:11:04,535 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:11:04,535 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:04,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:11:04,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 20:11:04,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 20:11:04,535 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:04,535 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:04,535 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 20:11:04,536 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:11:04,536 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:04,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 20:11:04,536 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:04,537 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 20:11:04,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 20:11:04,537 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:04,537 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 20:11:04,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:04,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:11:04,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:11:04,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:11:04,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 20:11:04,538 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34071,1689970216065' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-21 20:11:04,539 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4a51a325[Count = 1] remaining members to acquire global barrier 2023-07-21 20:11:04,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:11:04,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 20:11:04,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 20:11:04,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 20:11:04,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 20:11:04,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:04,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:11:04,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:11:04,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:11:04,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 20:11:04,541 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37823,1689970216018' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-21 20:11:04,541 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4a51a325[Count = 0] remaining members to acquire global barrier 2023-07-21 20:11:04,541 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-21 20:11:04,541 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:04,542 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:04,542 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:04,542 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:04,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:04,542 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:04,543 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-21 20:11:04,543 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:04,543 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-21 20:11:04,543 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,40099,1689970215928' in zk 2023-07-21 20:11:04,543 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:11:04,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:04,543 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-21 20:11:04,543 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 20:11:04,543 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 20:11:04,543 DEBUG [rs(jenkins-hbase4.apache.org,34071,1689970216065)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689970263828.7226df4663cd91f52a160159751a75c1. 2023-07-21 20:11:04,543 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:11:04,543 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-21 20:11:04,543 DEBUG [rs(jenkins-hbase4.apache.org,34071,1689970216065)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689970263828.7226df4663cd91f52a160159751a75c1. started... 2023-07-21 20:11:04,544 DEBUG [rs(jenkins-hbase4.apache.org,34071,1689970216065)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 7226df4663cd91f52a160159751a75c1: 2023-07-21 20:11:04,544 DEBUG [rs(jenkins-hbase4.apache.org,34071,1689970216065)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689970263828.7226df4663cd91f52a160159751a75c1.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:04,544 DEBUG [rs(jenkins-hbase4.apache.org,34071,1689970216065)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 20:11:04,544 DEBUG [rs(jenkins-hbase4.apache.org,34071,1689970216065)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-21 20:11:04,546 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:04,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:04,546 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-21 20:11:04,547 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 20:11:04,547 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 20:11:04,547 DEBUG [rs(jenkins-hbase4.apache.org,37823,1689970216018)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689970263828.26be4fd56ecb17c012a1fea3866c5c1b. 2023-07-21 20:11:04,547 DEBUG [rs(jenkins-hbase4.apache.org,37823,1689970216018)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689970263828.26be4fd56ecb17c012a1fea3866c5c1b. started... 2023-07-21 20:11:04,548 DEBUG [rs(jenkins-hbase4.apache.org,37823,1689970216018)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 26be4fd56ecb17c012a1fea3866c5c1b: 2023-07-21 20:11:04,549 DEBUG [rs(jenkins-hbase4.apache.org,37823,1689970216018)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689970263828.26be4fd56ecb17c012a1fea3866c5c1b.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:04,550 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-21 20:11:04,556 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 20:11:04,559 DEBUG [rs(jenkins-hbase4.apache.org,37823,1689970216018)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 20:11:04,559 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-21 20:11:04,560 DEBUG [rs(jenkins-hbase4.apache.org,37823,1689970216018)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-21 20:11:04,572 DEBUG [rs(jenkins-hbase4.apache.org,34071,1689970216065)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689970263828.7226df4663cd91f52a160159751a75c1. completed. 2023-07-21 20:11:04,572 DEBUG [rs(jenkins-hbase4.apache.org,34071,1689970216065)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689970263828.7226df4663cd91f52a160159751a75c1. 2023-07-21 20:11:04,572 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 20:11:04,572 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 20:11:04,572 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:11:04,574 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-21 20:11:04,574 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,34071,1689970216065' in zk 2023-07-21 20:11:04,576 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-21 20:11:04,576 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 20:11:04,576 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-21 20:11:04,576 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:11:04,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:11:04,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 20:11:04,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 20:11:04,579 DEBUG [rs(jenkins-hbase4.apache.org,37823,1689970216018)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689970263828.26be4fd56ecb17c012a1fea3866c5c1b. completed. 2023-07-21 20:11:04,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 20:11:04,579 DEBUG [rs(jenkins-hbase4.apache.org,37823,1689970216018)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689970263828.26be4fd56ecb17c012a1fea3866c5c1b. 2023-07-21 20:11:04,579 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 20:11:04,579 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 20:11:04,579 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:11:04,579 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-21 20:11:04,579 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,37823,1689970216018' in zk 2023-07-21 20:11:04,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 20:11:04,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:04,582 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:11:04,582 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-21 20:11:04,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:11:04,582 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 20:11:04,582 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-21 20:11:04,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:11:04,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:11:04,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 20:11:04,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:04,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:11:04,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:11:04,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:11:04,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,34071,1689970216065': 2023-07-21 20:11:04,586 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34071,1689970216065' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-21 20:11:04,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:11:04,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 20:11:04,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 20:11:04,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 20:11:04,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 20:11:04,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:04,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:11:04,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:11:04,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:11:04,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 20:11:04,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:04,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:11:04,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:11:04,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:11:04,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,37823,1689970216018': 2023-07-21 20:11:04,590 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37823,1689970216018' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-21 20:11:04,590 INFO [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-07-21 20:11:04,590 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-21 20:11:04,590 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-21 20:11:04,590 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:04,590 INFO [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-21 20:11:04,592 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:04,592 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:04,592 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:04,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:04,592 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:04,592 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:04,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:04,592 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:11:04,592 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:04,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:04,592 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:04,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 20:11:04,592 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:11:04,592 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:11:04,592 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:11:04,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 20:11:04,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:04,592 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:11:04,593 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:11:04,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:11:04,593 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:11:04,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:11:04,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:04,593 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:11:04,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:11:04,593 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:11:04,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 20:11:04,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:04,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:04,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:04,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 20:11:04,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:04,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:11:04,596 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:11:04,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:11:04,596 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:11:04,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:11:04,597 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:11:04,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 20:11:04,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:04,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:11:04,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:11:04,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:11:04,601 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:11:04,601 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:11:04,601 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:11:04,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:11:04,601 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:11:04,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:11:04,601 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:11:04,601 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:11:04,602 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports because node does not exist (not an error) 2023-07-21 20:11:04,602 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:04,602 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-07-21 20:11:04,602 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:04,602 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-21 20:11:04,601 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 20:11:04,601 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:11:04,602 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:11:04,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:11:04,602 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:11:04,604 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:11:04,604 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:11:04,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:11:04,604 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:04,604 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-21 20:11:04,604 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:11:04,605 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:11:04,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:11:04,605 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:11:04,605 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:04,605 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:11:04,605 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:04,605 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:11:04,605 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:11:04,605 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:04,605 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:04,605 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:11:04,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:11:04,605 DEBUG [Listener at jenkins-hbase4.apache.org/38105] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 20:11:04,606 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-21 20:11:04,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-21 20:11:04,607 DEBUG [Listener at jenkins-hbase4.apache.org/38105] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-21 20:11:04,613 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:04,614 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:04,637 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:04,668 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-21 20:11:04,668 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:04,668 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:04,668 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689970264504Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1689970264613 (+109 ms)Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1689970264613Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1689970264613Writing data manifest for emptySnaptb0-testConsecutiveExports at 1689970264618 (+5 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1689970264631 (+13 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689970264668 (+37 ms) 2023-07-21 20:11:04,671 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-21 20:11:04,673 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 166 msec 2023-07-21 20:11:04,807 DEBUG [Listener at jenkins-hbase4.apache.org/38105] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 20:11:04,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-21 20:11:04,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-21 20:11:04,811 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34071] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1689970263828.7226df4663cd91f52a160159751a75c1. with WAL disabled. Data may be lost in the event of a crash. 2023-07-21 20:11:04,813 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37823] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1689970263828.26be4fd56ecb17c012a1fea3866c5c1b. with WAL disabled. Data may be lost in the event of a crash. 2023-07-21 20:11:04,817 DEBUG [Listener at jenkins-hbase4.apache.org/38105] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-21 20:11:04,817 DEBUG [Listener at jenkins-hbase4.apache.org/38105] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1689970263828.7226df4663cd91f52a160159751a75c1. 2023-07-21 20:11:04,817 INFO [Listener at jenkins-hbase4.apache.org/38105] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-21 20:11:04,828 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-21 20:11:04,828 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689970264828 (current time:1689970264828). 2023-07-21 20:11:04,828 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-21 20:11:04,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] zookeeper.ReadOnlyZKClient(139): Connect 0x6c265b51 to 127.0.0.1:59101 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 20:11:04,840 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7ee73183, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 20:11:04,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 20:11:04,843 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49796, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 20:11:04,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6c265b51 to 127.0.0.1:59101 2023-07-21 20:11:04,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 20:11:04,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] zookeeper.ReadOnlyZKClient(139): Connect 0x5b83cb04 to 127.0.0.1:59101 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 20:11:04,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5a1fff6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 20:11:04,857 DEBUG [hconnection-0x420dbde8-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 20:11:04,861 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49812, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 20:11:04,865 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 20:11:04,866 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42416, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 20:11:04,868 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5b83cb04 to 127.0.0.1:59101 2023-07-21 20:11:04,868 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 20:11:04,868 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-21 20:11:04,869 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-21 20:11:04,869 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-21 20:11:04,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-21 20:11:04,872 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-21 20:11:04,873 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689970864873 2023-07-21 20:11:04,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-21 20:11:04,873 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-21 20:11:04,875 DEBUG [Listener at jenkins-hbase4.apache.org/38105] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-21 20:11:04,875 DEBUG [Listener at jenkins-hbase4.apache.org/38105] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-21 20:11:04,878 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-21 20:11:04,878 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-21 20:11:04,879 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 8 msec 2023-07-21 20:11:04,880 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-21 20:11:04,881 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689970864881 2023-07-21 20:11:04,892 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-07-21 20:11:04,892 INFO [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-07-21 20:11:04,892 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 20:11:04,894 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-07-21 20:11:04,894 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-21 20:11:04,894 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-21 20:11:04,894 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-21 20:11:04,896 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:11:04,896 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:11:04,896 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:11:04,896 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:11:04,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:11:04,896 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:11:04,896 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:11:04,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:11:04,896 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:11:04,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:11:04,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-21 20:11:04,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-21 20:11:04,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-21 20:11:04,897 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:11:04,897 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:11:04,897 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-21 20:11:04,897 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-21 20:11:04,897 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-21 20:11:04,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-21 20:11:04,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-21 20:11:04,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-21 20:11:04,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-21 20:11:04,898 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-21 20:11:04,898 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-21 20:11:04,898 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:11:04,898 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-21 20:11:04,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-21 20:11:04,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-21 20:11:04,898 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-21 20:11:04,899 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-21 20:11:04,899 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-21 20:11:04,899 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-21 20:11:04,900 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-21 20:11:04,900 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 20:11:04,900 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 20:11:04,904 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-21 20:11:04,904 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-21 20:11:04,904 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-21 20:11:04,904 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34071,1689970216065' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-21 20:11:04,904 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-21 20:11:04,904 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-21 20:11:04,904 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 20:11:04,904 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-21 20:11:04,905 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-21 20:11:04,905 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-21 20:11:04,905 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40099,1689970215928' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-21 20:11:04,905 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37823,1689970216018' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-21 20:11:04,907 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-21 20:11:04,907 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:11:04,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:11:04,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 20:11:04,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 20:11:04,909 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-21 20:11:04,909 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-21 20:11:04,910 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:11:04,909 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-21 20:11:04,910 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 20:11:04,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 20:11:04,910 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-21 20:11:04,910 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 20:11:04,910 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-21 20:11:04,910 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 20:11:04,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 20:11:04,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-21 20:11:04,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:11:04,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:11:04,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:11:04,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 20:11:04,912 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34071,1689970216065' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-21 20:11:04,912 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@707a992b[Count = 1] remaining members to acquire global barrier 2023-07-21 20:11:04,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:11:04,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 20:11:04,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 20:11:04,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 20:11:04,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 20:11:04,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-21 20:11:04,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:11:04,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:11:04,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:11:04,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 20:11:04,914 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37823,1689970216018' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-21 20:11:04,914 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@707a992b[Count = 0] remaining members to acquire global barrier 2023-07-21 20:11:04,914 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-21 20:11:04,914 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-21 20:11:04,916 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-21 20:11:04,916 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-21 20:11:04,916 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-21 20:11:04,916 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-21 20:11:04,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-21 20:11:04,916 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-21 20:11:04,916 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-21 20:11:04,916 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-21 20:11:04,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-21 20:11:04,916 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-21 20:11:04,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-21 20:11:04,916 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:11:04,916 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-21 20:11:04,916 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-21 20:11:04,916 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,40099,1689970215928' in zk 2023-07-21 20:11:04,916 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 20:11:04,916 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 20:11:04,917 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 20:11:04,917 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 20:11:04,917 DEBUG [rs(jenkins-hbase4.apache.org,34071,1689970216065)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689970263828.7226df4663cd91f52a160159751a75c1. 2023-07-21 20:11:04,917 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:11:04,917 DEBUG [rs(jenkins-hbase4.apache.org,37823,1689970216018)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689970263828.26be4fd56ecb17c012a1fea3866c5c1b. 2023-07-21 20:11:04,917 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-21 20:11:04,917 DEBUG [rs(jenkins-hbase4.apache.org,34071,1689970216065)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689970263828.7226df4663cd91f52a160159751a75c1. started... 2023-07-21 20:11:04,917 DEBUG [rs(jenkins-hbase4.apache.org,37823,1689970216018)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689970263828.26be4fd56ecb17c012a1fea3866c5c1b. started... 2023-07-21 20:11:04,917 INFO [rs(jenkins-hbase4.apache.org,34071,1689970216065)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 7226df4663cd91f52a160159751a75c1 1/1 column families, dataSize=132 B heapSize=544 B 2023-07-21 20:11:04,917 INFO [rs(jenkins-hbase4.apache.org,37823,1689970216018)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 26be4fd56ecb17c012a1fea3866c5c1b 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-07-21 20:11:04,918 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-21 20:11:04,918 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 20:11:04,918 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-21 20:11:04,960 INFO [rs(jenkins-hbase4.apache.org,34071,1689970216065)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230721f7f788309e0e4b6399be8d36b11649ee to hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230721f7f788309e0e4b6399be8d36b11649ee 2023-07-21 20:11:04,964 INFO [rs(jenkins-hbase4.apache.org,37823,1689970216018)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202307214930a072abc04dcfb513a0d562acada1 to hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202307214930a072abc04dcfb513a0d562acada1 2023-07-21 20:11:04,975 DEBUG [Listener at jenkins-hbase4.apache.org/38105] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 20:11:04,976 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-21 20:11:04,976 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-21 20:11:04,976 DEBUG [Listener at jenkins-hbase4.apache.org/38105] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-21 20:11:04,978 INFO [rs(jenkins-hbase4.apache.org,34071,1689970216065)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testConsecutiveExports/7226df4663cd91f52a160159751a75c1/.tmp/cf/ac89478ea3ba4b94b232aee321fdbbcf 2023-07-21 20:11:04,982 INFO [rs(jenkins-hbase4.apache.org,37823,1689970216018)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testConsecutiveExports/26be4fd56ecb17c012a1fea3866c5c1b/.tmp/cf/1237df5a159f4717a680d262a0ae25cd 2023-07-21 20:11:04,985 DEBUG [rs(jenkins-hbase4.apache.org,34071,1689970216065)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testConsecutiveExports/7226df4663cd91f52a160159751a75c1/.tmp/cf/ac89478ea3ba4b94b232aee321fdbbcf as hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testConsecutiveExports/7226df4663cd91f52a160159751a75c1/cf/ac89478ea3ba4b94b232aee321fdbbcf 2023-07-21 20:11:04,987 DEBUG [rs(jenkins-hbase4.apache.org,37823,1689970216018)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testConsecutiveExports/26be4fd56ecb17c012a1fea3866c5c1b/.tmp/cf/1237df5a159f4717a680d262a0ae25cd as hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testConsecutiveExports/26be4fd56ecb17c012a1fea3866c5c1b/cf/1237df5a159f4717a680d262a0ae25cd 2023-07-21 20:11:04,991 INFO [rs(jenkins-hbase4.apache.org,34071,1689970216065)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testConsecutiveExports/7226df4663cd91f52a160159751a75c1/cf/ac89478ea3ba4b94b232aee321fdbbcf, entries=2, sequenceid=6, filesize=5.2 K 2023-07-21 20:11:04,992 INFO [rs(jenkins-hbase4.apache.org,34071,1689970216065)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for 7226df4663cd91f52a160159751a75c1 in 75ms, sequenceid=6, compaction requested=false 2023-07-21 20:11:04,992 DEBUG [rs(jenkins-hbase4.apache.org,34071,1689970216065)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-21 20:11:04,993 DEBUG [rs(jenkins-hbase4.apache.org,34071,1689970216065)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 7226df4663cd91f52a160159751a75c1: 2023-07-21 20:11:04,993 DEBUG [rs(jenkins-hbase4.apache.org,34071,1689970216065)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689970263828.7226df4663cd91f52a160159751a75c1.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-21 20:11:04,993 DEBUG [rs(jenkins-hbase4.apache.org,34071,1689970216065)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 20:11:04,993 DEBUG [rs(jenkins-hbase4.apache.org,34071,1689970216065)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testConsecutiveExports/7226df4663cd91f52a160159751a75c1/cf/ac89478ea3ba4b94b232aee321fdbbcf] hfiles 2023-07-21 20:11:04,993 INFO [rs(jenkins-hbase4.apache.org,37823,1689970216018)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testConsecutiveExports/26be4fd56ecb17c012a1fea3866c5c1b/cf/1237df5a159f4717a680d262a0ae25cd, entries=48, sequenceid=6, filesize=12.9 K 2023-07-21 20:11:04,993 DEBUG [rs(jenkins-hbase4.apache.org,34071,1689970216065)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testConsecutiveExports/7226df4663cd91f52a160159751a75c1/cf/ac89478ea3ba4b94b232aee321fdbbcf for snapshot=snaptb0-testConsecutiveExports 2023-07-21 20:11:04,994 INFO [rs(jenkins-hbase4.apache.org,37823,1689970216018)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for 26be4fd56ecb17c012a1fea3866c5c1b in 77ms, sequenceid=6, compaction requested=false 2023-07-21 20:11:04,996 DEBUG [rs(jenkins-hbase4.apache.org,37823,1689970216018)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 26be4fd56ecb17c012a1fea3866c5c1b: 2023-07-21 20:11:04,996 DEBUG [rs(jenkins-hbase4.apache.org,37823,1689970216018)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689970263828.26be4fd56ecb17c012a1fea3866c5c1b.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-21 20:11:04,996 DEBUG [rs(jenkins-hbase4.apache.org,37823,1689970216018)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 20:11:04,996 DEBUG [rs(jenkins-hbase4.apache.org,37823,1689970216018)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testConsecutiveExports/26be4fd56ecb17c012a1fea3866c5c1b/cf/1237df5a159f4717a680d262a0ae25cd] hfiles 2023-07-21 20:11:04,996 DEBUG [rs(jenkins-hbase4.apache.org,37823,1689970216018)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testConsecutiveExports/26be4fd56ecb17c012a1fea3866c5c1b/cf/1237df5a159f4717a680d262a0ae25cd for snapshot=snaptb0-testConsecutiveExports 2023-07-21 20:11:05,004 DEBUG [rs(jenkins-hbase4.apache.org,34071,1689970216065)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689970263828.7226df4663cd91f52a160159751a75c1. completed. 2023-07-21 20:11:05,004 DEBUG [rs(jenkins-hbase4.apache.org,34071,1689970216065)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689970263828.7226df4663cd91f52a160159751a75c1. 2023-07-21 20:11:05,004 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 20:11:05,004 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 20:11:05,004 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:11:05,004 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-21 20:11:05,004 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,34071,1689970216065' in zk 2023-07-21 20:11:05,007 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:11:05,007 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-21 20:11:05,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:11:05,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 20:11:05,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 20:11:05,007 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 20:11:05,007 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-21 20:11:05,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 20:11:05,010 DEBUG [rs(jenkins-hbase4.apache.org,37823,1689970216018)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689970263828.26be4fd56ecb17c012a1fea3866c5c1b. completed. 2023-07-21 20:11:05,010 DEBUG [rs(jenkins-hbase4.apache.org,37823,1689970216018)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689970263828.26be4fd56ecb17c012a1fea3866c5c1b. 2023-07-21 20:11:05,011 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 20:11:05,011 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 20:11:05,011 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:11:05,011 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-21 20:11:05,011 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,37823,1689970216018' in zk 2023-07-21 20:11:05,012 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:11:05,012 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-21 20:11:05,012 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 20:11:05,012 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-21 20:11:05,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 20:11:05,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-21 20:11:05,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:11:05,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:11:05,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:11:05,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 20:11:05,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-21 20:11:05,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:11:05,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:11:05,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:11:05,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,34071,1689970216065': 2023-07-21 20:11:05,017 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34071,1689970216065' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-21 20:11:05,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:11:05,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 20:11:05,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 20:11:05,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 20:11:05,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 20:11:05,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-21 20:11:05,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:11:05,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:11:05,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:11:05,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 20:11:05,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-21 20:11:05,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:11:05,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:11:05,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:11:05,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,37823,1689970216018': 2023-07-21 20:11:05,021 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37823,1689970216018' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-21 20:11:05,021 INFO [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-07-21 20:11:05,021 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-21 20:11:05,021 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-21 20:11:05,021 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-07-21 20:11:05,021 INFO [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-21 20:11:05,023 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-21 20:11:05,023 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-21 20:11:05,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-21 20:11:05,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 20:11:05,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 20:11:05,023 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-21 20:11:05,023 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-21 20:11:05,023 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:11:05,023 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:11:05,023 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-21 20:11:05,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-21 20:11:05,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 20:11:05,023 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-21 20:11:05,023 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-21 20:11:05,023 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:11:05,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-21 20:11:05,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-21 20:11:05,024 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:11:05,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:11:05,024 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:11:05,024 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:11:05,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:11:05,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-21 20:11:05,024 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:11:05,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:11:05,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-21 20:11:05,024 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:11:05,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-21 20:11:05,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-21 20:11:05,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 20:11:05,025 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:11:05,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-21 20:11:05,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:11:05,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:11:05,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:11:05,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 20:11:05,027 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:11:05,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-21 20:11:05,027 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:11:05,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:11:05,028 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:11:05,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:11:05,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:11:05,034 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:11:05,034 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:11:05,034 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-21 20:11:05,034 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:11:05,034 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:11:05,034 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:11:05,034 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:11:05,034 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:11:05,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:11:05,034 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-07-21 20:11:05,035 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-07-21 20:11:05,035 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-21 20:11:05,035 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-21 20:11:05,035 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:11:05,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:11:05,034 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:11:05,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:11:05,034 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:11:05,034 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:11:05,035 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-21 20:11:05,036 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:11:05,034 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 20:11:05,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:11:05,036 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202307214930a072abc04dcfb513a0d562acada1, hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230721f7f788309e0e4b6399be8d36b11649ee] mob files 2023-07-21 20:11:05,036 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:11:05,037 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202307214930a072abc04dcfb513a0d562acada1 2023-07-21 20:11:05,036 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:11:05,037 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230721f7f788309e0e4b6399be8d36b11649ee 2023-07-21 20:11:05,037 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-21 20:11:05,037 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:11:05,037 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:11:05,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:11:05,037 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:11:05,038 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-21 20:11:05,038 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-21 20:11:05,038 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:11:05,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:11:05,049 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-07-21 20:11:05,050 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-21 20:11:05,081 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-21 20:11:05,104 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-21 20:11:05,104 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-21 20:11:05,104 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-21 20:11:05,104 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689970264873Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1689970265049 (+176 ms)Consolidate snapshot: snaptb0-testConsecutiveExports at 1689970265049Loading Region manifests for snaptb0-testConsecutiveExports at 1689970265049Writing data manifest for snaptb0-testConsecutiveExports at 1689970265060 (+11 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1689970265073 (+13 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689970265104 (+31 ms) 2023-07-21 20:11:05,107 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-21 20:11:05,109 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 233 msec 2023-07-21 20:11:05,176 DEBUG [Listener at jenkins-hbase4.apache.org/38105] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 20:11:05,178 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-21 20:11:05,178 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-21 20:11:05,178 INFO [Listener at jenkins-hbase4.apache.org/38105] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c4475fbf-6a12-c189-d7a2-889953ef4b74/local-export-1689970265178 2023-07-21 20:11:05,178 INFO [Listener at jenkins-hbase4.apache.org/38105] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c4475fbf-6a12-c189-d7a2-889953ef4b74/local-export-1689970265178, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c4475fbf-6a12-c189-d7a2-889953ef4b74/local-export-1689970265178, srcFsUri=hdfs://localhost:40641, srcDir=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00 2023-07-21 20:11:05,201 DEBUG [Listener at jenkins-hbase4.apache.org/38105] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:40641, inputRoot=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00 2023-07-21 20:11:05,201 DEBUG [Listener at jenkins-hbase4.apache.org/38105] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@44781015, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c4475fbf-6a12-c189-d7a2-889953ef4b74/local-export-1689970265178, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c4475fbf-6a12-c189-d7a2-889953ef4b74/local-export-1689970265178/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-21 20:11:05,201 INFO [Listener at jenkins-hbase4.apache.org/38105] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:40641, inputRoot=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00, snapshotDir=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-21 20:11:05,210 INFO [Listener at jenkins-hbase4.apache.org/38105] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c4475fbf-6a12-c189-d7a2-889953ef4b74/local-export-1689970265178/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-21 20:11:05,225 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-21 20:11:05,226 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-21 20:11:05,226 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-21 20:11:05,227 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-21 20:11:06,184 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c4475fbf-6a12-c189-d7a2-889953ef4b74/hadoop-8600056036208569341.jar 2023-07-21 20:11:06,185 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-21 20:11:06,185 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-21 20:11:06,256 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c4475fbf-6a12-c189-d7a2-889953ef4b74/hadoop-5979182722949909855.jar 2023-07-21 20:11:06,256 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-21 20:11:06,257 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-21 20:11:06,257 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-21 20:11:06,258 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-21 20:11:06,259 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-21 20:11:06,259 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-21 20:11:06,260 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-21 20:11:06,260 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-21 20:11:06,261 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-21 20:11:06,261 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-21 20:11:06,261 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-21 20:11:06,262 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-21 20:11:06,262 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-21 20:11:06,262 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-21 20:11:06,263 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-21 20:11:06,263 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-21 20:11:06,264 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 20:11:06,264 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 20:11:06,265 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-21 20:11:06,265 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 20:11:06,265 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 20:11:06,266 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-21 20:11:06,266 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-21 20:11:06,646 WARN [Listener at jenkins-hbase4.apache.org/38105] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-21 20:11:06,649 INFO [Listener at jenkins-hbase4.apache.org/38105] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-21 20:11:06,651 DEBUG [Listener at jenkins-hbase4.apache.org/38105] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-07-21 20:11:07,657 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-21 20:11:07,658 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-21 20:11:07,661 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689970225203_0002_000001 (auth:SIMPLE) 2023-07-21 20:11:08,569 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689970225203_0003_000001 (auth:SIMPLE) 2023-07-21 20:11:08,917 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-21 20:11:13,191 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689970225203_0003_000001 (auth:SIMPLE) 2023-07-21 20:11:15,481 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689970225203_0003_000001 (auth:SIMPLE) 2023-07-21 20:11:18,205 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689970225203_0003_000001 (auth:SIMPLE) 2023-07-21 20:11:19,821 INFO [Listener at jenkins-hbase4.apache.org/38105] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-21 20:11:19,821 INFO [Listener at jenkins-hbase4.apache.org/38105] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-21 20:11:19,826 INFO [Listener at jenkins-hbase4.apache.org/38105] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-21 20:11:19,826 INFO [Listener at jenkins-hbase4.apache.org/38105] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-21 20:11:19,826 INFO [Listener at jenkins-hbase4.apache.org/38105] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-21 20:11:19,827 DEBUG [Listener at jenkins-hbase4.apache.org/38105] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_895530006_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-21 20:11:19,829 DEBUG [Listener at jenkins-hbase4.apache.org/38105] snapshot.TestExportSnapshot(367): hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-21 20:11:19,829 DEBUG [Listener at jenkins-hbase4.apache.org/38105] snapshot.TestExportSnapshot(367): hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-21 20:11:19,829 DEBUG [Listener at jenkins-hbase4.apache.org/38105] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@59c33cb8 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c4475fbf-6a12-c189-d7a2-889953ef4b74/local-export-1689970265178/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c4475fbf-6a12-c189-d7a2-889953ef4b74/local-export-1689970265178/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-21 20:11:19,829 DEBUG [Listener at jenkins-hbase4.apache.org/38105] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c4475fbf-6a12-c189-d7a2-889953ef4b74/local-export-1689970265178/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-21 20:11:19,829 DEBUG [Listener at jenkins-hbase4.apache.org/38105] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c4475fbf-6a12-c189-d7a2-889953ef4b74/local-export-1689970265178/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-21 20:11:19,830 INFO [Listener at jenkins-hbase4.apache.org/38105] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c4475fbf-6a12-c189-d7a2-889953ef4b74/local-export-1689970265178, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c4475fbf-6a12-c189-d7a2-889953ef4b74/local-export-1689970265178, srcFsUri=hdfs://localhost:40641, srcDir=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00 2023-07-21 20:11:19,856 DEBUG [Listener at jenkins-hbase4.apache.org/38105] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:40641, inputRoot=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00 2023-07-21 20:11:19,856 DEBUG [Listener at jenkins-hbase4.apache.org/38105] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@61393c8, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c4475fbf-6a12-c189-d7a2-889953ef4b74/local-export-1689970265178, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c4475fbf-6a12-c189-d7a2-889953ef4b74/local-export-1689970265178/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-21 20:11:19,856 INFO [Listener at jenkins-hbase4.apache.org/38105] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:40641, inputRoot=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00, snapshotDir=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-21 20:11:19,866 INFO [Listener at jenkins-hbase4.apache.org/38105] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c4475fbf-6a12-c189-d7a2-889953ef4b74/local-export-1689970265178/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-21 20:11:19,879 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-21 20:11:19,880 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-21 20:11:19,881 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-21 20:11:19,881 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-21 20:11:20,818 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c4475fbf-6a12-c189-d7a2-889953ef4b74/hadoop-7314282261586504989.jar 2023-07-21 20:11:20,818 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-21 20:11:20,819 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-21 20:11:20,893 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c4475fbf-6a12-c189-d7a2-889953ef4b74/hadoop-4470517118440213665.jar 2023-07-21 20:11:20,893 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-21 20:11:20,894 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-21 20:11:20,894 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-21 20:11:20,895 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-21 20:11:20,895 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-21 20:11:20,896 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-21 20:11:20,896 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-21 20:11:20,896 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-21 20:11:20,897 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-21 20:11:20,897 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-21 20:11:20,897 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-21 20:11:20,898 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-21 20:11:20,899 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-21 20:11:20,899 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-21 20:11:20,899 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-21 20:11:20,900 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-21 20:11:20,901 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 20:11:20,901 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 20:11:20,902 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-21 20:11:20,902 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 20:11:20,902 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 20:11:20,903 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-21 20:11:20,904 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-21 20:11:21,334 WARN [Listener at jenkins-hbase4.apache.org/38105] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-21 20:11:21,336 INFO [Listener at jenkins-hbase4.apache.org/38105] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-21 20:11:21,338 DEBUG [Listener at jenkins-hbase4.apache.org/38105] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-07-21 20:11:24,390 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-21 20:11:24,390 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-21 20:11:24,393 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689970225203_0003_000001 (auth:SIMPLE) 2023-07-21 20:11:24,675 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689970225203_0004_000001 (auth:SIMPLE) 2023-07-21 20:11:29,686 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689970225203_0004_000001 (auth:SIMPLE) 2023-07-21 20:11:31,967 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689970225203_0004_000001 (auth:SIMPLE) 2023-07-21 20:11:36,955 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689970225203_0004_000001 (auth:SIMPLE) 2023-07-21 20:11:38,560 INFO [Listener at jenkins-hbase4.apache.org/38105] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-21 20:11:38,560 INFO [Listener at jenkins-hbase4.apache.org/38105] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-21 20:11:38,565 INFO [Listener at jenkins-hbase4.apache.org/38105] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-21 20:11:38,565 INFO [Listener at jenkins-hbase4.apache.org/38105] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-21 20:11:38,566 INFO [Listener at jenkins-hbase4.apache.org/38105] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-21 20:11:38,566 DEBUG [Listener at jenkins-hbase4.apache.org/38105] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_895530006_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-21 20:11:38,569 DEBUG [Listener at jenkins-hbase4.apache.org/38105] snapshot.TestExportSnapshot(367): hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-21 20:11:38,569 DEBUG [Listener at jenkins-hbase4.apache.org/38105] snapshot.TestExportSnapshot(367): hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-21 20:11:38,569 DEBUG [Listener at jenkins-hbase4.apache.org/38105] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@59c33cb8 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c4475fbf-6a12-c189-d7a2-889953ef4b74/local-export-1689970265178/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c4475fbf-6a12-c189-d7a2-889953ef4b74/local-export-1689970265178/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-21 20:11:38,569 DEBUG [Listener at jenkins-hbase4.apache.org/38105] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c4475fbf-6a12-c189-d7a2-889953ef4b74/local-export-1689970265178/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-21 20:11:38,569 DEBUG [Listener at jenkins-hbase4.apache.org/38105] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c4475fbf-6a12-c189-d7a2-889953ef4b74/local-export-1689970265178/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-21 20:11:38,584 INFO [Listener at jenkins-hbase4.apache.org/38105] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-07-21 20:11:38,584 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-07-21 20:11:38,585 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] procedure2.ProcedureExecutor(1029): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-07-21 20:11:38,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-21 20:11:38,591 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689970298591"}]},"ts":"1689970298591"} 2023-07-21 20:11:38,592 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-07-21 20:11:38,594 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-07-21 20:11:38,595 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=7226df4663cd91f52a160159751a75c1, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=26be4fd56ecb17c012a1fea3866c5c1b, UNASSIGN}] 2023-07-21 20:11:38,598 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=7226df4663cd91f52a160159751a75c1, UNASSIGN 2023-07-21 20:11:38,598 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=26be4fd56ecb17c012a1fea3866c5c1b, UNASSIGN 2023-07-21 20:11:38,599 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=7226df4663cd91f52a160159751a75c1, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:11:38,599 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689970263828.7226df4663cd91f52a160159751a75c1.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689970298599"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689970298599"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689970298599"}]},"ts":"1689970298599"} 2023-07-21 20:11:38,599 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=26be4fd56ecb17c012a1fea3866c5c1b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:11:38,599 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689970263828.26be4fd56ecb17c012a1fea3866c5c1b.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689970298599"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689970298599"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689970298599"}]},"ts":"1689970298599"} 2023-07-21 20:11:38,607 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=54, ppid=52, state=RUNNABLE; CloseRegionProcedure 7226df4663cd91f52a160159751a75c1, server=jenkins-hbase4.apache.org,34071,1689970216065}] 2023-07-21 20:11:38,608 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=55, ppid=53, state=RUNNABLE; CloseRegionProcedure 26be4fd56ecb17c012a1fea3866c5c1b, server=jenkins-hbase4.apache.org,37823,1689970216018}] 2023-07-21 20:11:38,692 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-21 20:11:38,760 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 7226df4663cd91f52a160159751a75c1 2023-07-21 20:11:38,760 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 7226df4663cd91f52a160159751a75c1, disabling compactions & flushes 2023-07-21 20:11:38,760 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689970263828.7226df4663cd91f52a160159751a75c1. 2023-07-21 20:11:38,760 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689970263828.7226df4663cd91f52a160159751a75c1. 2023-07-21 20:11:38,760 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689970263828.7226df4663cd91f52a160159751a75c1. after waiting 0 ms 2023-07-21 20:11:38,760 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689970263828.7226df4663cd91f52a160159751a75c1. 2023-07-21 20:11:38,761 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 26be4fd56ecb17c012a1fea3866c5c1b 2023-07-21 20:11:38,761 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 26be4fd56ecb17c012a1fea3866c5c1b, disabling compactions & flushes 2023-07-21 20:11:38,761 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689970263828.26be4fd56ecb17c012a1fea3866c5c1b. 2023-07-21 20:11:38,761 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689970263828.26be4fd56ecb17c012a1fea3866c5c1b. 2023-07-21 20:11:38,761 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689970263828.26be4fd56ecb17c012a1fea3866c5c1b. after waiting 0 ms 2023-07-21 20:11:38,761 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689970263828.26be4fd56ecb17c012a1fea3866c5c1b. 2023-07-21 20:11:38,774 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testConsecutiveExports/7226df4663cd91f52a160159751a75c1/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-21 20:11:38,775 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testConsecutiveExports/26be4fd56ecb17c012a1fea3866c5c1b/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-21 20:11:38,775 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 20:11:38,776 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689970263828.7226df4663cd91f52a160159751a75c1. 2023-07-21 20:11:38,776 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 7226df4663cd91f52a160159751a75c1: 2023-07-21 20:11:38,776 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 20:11:38,777 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689970263828.26be4fd56ecb17c012a1fea3866c5c1b. 2023-07-21 20:11:38,777 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 26be4fd56ecb17c012a1fea3866c5c1b: 2023-07-21 20:11:38,779 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 7226df4663cd91f52a160159751a75c1 2023-07-21 20:11:38,780 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=7226df4663cd91f52a160159751a75c1, regionState=CLOSED 2023-07-21 20:11:38,780 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 26be4fd56ecb17c012a1fea3866c5c1b 2023-07-21 20:11:38,780 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689970263828.7226df4663cd91f52a160159751a75c1.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689970298780"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689970298780"}]},"ts":"1689970298780"} 2023-07-21 20:11:38,781 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=26be4fd56ecb17c012a1fea3866c5c1b, regionState=CLOSED 2023-07-21 20:11:38,781 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689970263828.26be4fd56ecb17c012a1fea3866c5c1b.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689970298781"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689970298781"}]},"ts":"1689970298781"} 2023-07-21 20:11:38,800 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=54, resume processing ppid=52 2023-07-21 20:11:38,800 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=54, ppid=52, state=SUCCESS; CloseRegionProcedure 7226df4663cd91f52a160159751a75c1, server=jenkins-hbase4.apache.org,34071,1689970216065 in 175 msec 2023-07-21 20:11:38,801 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=55, resume processing ppid=53 2023-07-21 20:11:38,801 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=55, ppid=53, state=SUCCESS; CloseRegionProcedure 26be4fd56ecb17c012a1fea3866c5c1b, server=jenkins-hbase4.apache.org,37823,1689970216018 in 186 msec 2023-07-21 20:11:38,802 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=7226df4663cd91f52a160159751a75c1, UNASSIGN in 205 msec 2023-07-21 20:11:38,804 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=51 2023-07-21 20:11:38,804 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=26be4fd56ecb17c012a1fea3866c5c1b, UNASSIGN in 206 msec 2023-07-21 20:11:38,804 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689970298804"}]},"ts":"1689970298804"} 2023-07-21 20:11:38,806 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-07-21 20:11:38,820 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-07-21 20:11:38,822 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 237 msec 2023-07-21 20:11:38,894 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-21 20:11:38,894 INFO [Listener at jenkins-hbase4.apache.org/38105] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-07-21 20:11:38,895 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-07-21 20:11:38,896 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] procedure2.ProcedureExecutor(1029): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-21 20:11:38,901 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-21 20:11:38,902 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-07-21 20:11:38,903 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-21 20:11:38,906 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37823] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-07-21 20:11:38,926 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testConsecutiveExports/7226df4663cd91f52a160159751a75c1 2023-07-21 20:11:38,927 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testConsecutiveExports/26be4fd56ecb17c012a1fea3866c5c1b 2023-07-21 20:11:38,930 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testConsecutiveExports/7226df4663cd91f52a160159751a75c1/cf, FileablePath, hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testConsecutiveExports/7226df4663cd91f52a160159751a75c1/recovered.edits] 2023-07-21 20:11:38,930 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testConsecutiveExports/26be4fd56ecb17c012a1fea3866c5c1b/cf, FileablePath, hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testConsecutiveExports/26be4fd56ecb17c012a1fea3866c5c1b/recovered.edits] 2023-07-21 20:11:38,935 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-21 20:11:38,935 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-21 20:11:38,935 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-21 20:11:38,936 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-21 20:11:38,935 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-21 20:11:38,936 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-21 20:11:38,951 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-21 20:11:38,951 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 20:11:38,951 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data null 2023-07-21 20:11:38,951 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 20:11:38,951 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 20:11:38,951 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-21 20:11:38,951 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-21 20:11:38,952 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 20:11:38,951 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data null 2023-07-21 20:11:38,952 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-21 20:11:38,953 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-21 20:11:38,953 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testConsecutiveExports/7226df4663cd91f52a160159751a75c1/cf/ac89478ea3ba4b94b232aee321fdbbcf to hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/archive/data/default/testtb-testConsecutiveExports/7226df4663cd91f52a160159751a75c1/cf/ac89478ea3ba4b94b232aee321fdbbcf 2023-07-21 20:11:38,962 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testConsecutiveExports/7226df4663cd91f52a160159751a75c1/recovered.edits/9.seqid to hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/archive/data/default/testtb-testConsecutiveExports/7226df4663cd91f52a160159751a75c1/recovered.edits/9.seqid 2023-07-21 20:11:38,965 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testConsecutiveExports/7226df4663cd91f52a160159751a75c1 2023-07-21 20:11:38,967 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testConsecutiveExports/26be4fd56ecb17c012a1fea3866c5c1b/cf/1237df5a159f4717a680d262a0ae25cd to hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/archive/data/default/testtb-testConsecutiveExports/26be4fd56ecb17c012a1fea3866c5c1b/cf/1237df5a159f4717a680d262a0ae25cd 2023-07-21 20:11:38,972 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testConsecutiveExports/26be4fd56ecb17c012a1fea3866c5c1b/recovered.edits/9.seqid to hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/archive/data/default/testtb-testConsecutiveExports/26be4fd56ecb17c012a1fea3866c5c1b/recovered.edits/9.seqid 2023-07-21 20:11:38,972 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testConsecutiveExports/26be4fd56ecb17c012a1fea3866c5c1b 2023-07-21 20:11:38,972 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-21 20:11:38,973 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-07-21 20:11:38,974 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf] 2023-07-21 20:11:38,983 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202307214930a072abc04dcfb513a0d562acada1 to hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202307214930a072abc04dcfb513a0d562acada1 2023-07-21 20:11:38,986 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230721f7f788309e0e4b6399be8d36b11649ee to hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230721f7f788309e0e4b6399be8d36b11649ee 2023-07-21 20:11:38,986 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-07-21 20:11:38,990 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-21 20:11:38,997 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-07-21 20:11:39,001 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-07-21 20:11:39,014 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-21 20:11:39,014 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-07-21 20:11:39,015 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1689970263828.7226df4663cd91f52a160159751a75c1.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689970299014"}]},"ts":"9223372036854775807"} 2023-07-21 20:11:39,015 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1689970263828.26be4fd56ecb17c012a1fea3866c5c1b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689970299014"}]},"ts":"9223372036854775807"} 2023-07-21 20:11:39,017 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-21 20:11:39,017 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 7226df4663cd91f52a160159751a75c1, NAME => 'testtb-testConsecutiveExports,,1689970263828.7226df4663cd91f52a160159751a75c1.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 26be4fd56ecb17c012a1fea3866c5c1b, NAME => 'testtb-testConsecutiveExports,1,1689970263828.26be4fd56ecb17c012a1fea3866c5c1b.', STARTKEY => '1', ENDKEY => ''}] 2023-07-21 20:11:39,017 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-07-21 20:11:39,018 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689970299017"}]},"ts":"9223372036854775807"} 2023-07-21 20:11:39,030 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-07-21 20:11:39,036 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-21 20:11:39,041 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 142 msec 2023-07-21 20:11:39,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-21 20:11:39,055 INFO [Listener at jenkins-hbase4.apache.org/38105] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-07-21 20:11:39,106 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-07-21 20:11:39,109 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:39,112 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-07-21 20:11:39,115 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-07-21 20:11:39,147 INFO [Listener at jenkins-hbase4.apache.org/38105] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=746 (was 761), OpenFileDescriptor=901 (was 922), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=376 (was 298) - SystemLoadAverage LEAK? -, ProcessCount=187 (was 185) - ProcessCount LEAK? -, AvailableMemoryMB=6801 (was 7409) 2023-07-21 20:11:39,147 WARN [Listener at jenkins-hbase4.apache.org/38105] hbase.ResourceChecker(130): Thread=746 is superior to 500 2023-07-21 20:11:39,172 INFO [Listener at jenkins-hbase4.apache.org/38105] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=746, OpenFileDescriptor=901, MaxFileDescriptor=60000, SystemLoadAverage=376, ProcessCount=187, AvailableMemoryMB=6795 2023-07-21 20:11:39,172 WARN [Listener at jenkins-hbase4.apache.org/38105] hbase.ResourceChecker(130): Thread=746 is superior to 500 2023-07-21 20:11:39,175 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-21 20:11:39,176 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] procedure2.ProcedureExecutor(1029): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:39,182 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-07-21 20:11:39,182 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-07-21 20:11:39,183 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-21 20:11:39,183 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-21 20:11:39,186 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/862fffd487c840233dd7c2f0f87615f0 2023-07-21 20:11:39,186 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/6369aefa274a2c3b89e9054606b5b045 2023-07-21 20:11:39,187 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/6369aefa274a2c3b89e9054606b5b045 empty. 2023-07-21 20:11:39,187 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/862fffd487c840233dd7c2f0f87615f0 empty. 2023-07-21 20:11:39,187 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/862fffd487c840233dd7c2f0f87615f0 2023-07-21 20:11:39,187 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/6369aefa274a2c3b89e9054606b5b045 2023-07-21 20:11:39,187 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-21 20:11:39,212 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-07-21 20:11:39,214 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => 862fffd487c840233dd7c2f0f87615f0, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689970299174.862fffd487c840233dd7c2f0f87615f0.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp 2023-07-21 20:11:39,214 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => 6369aefa274a2c3b89e9054606b5b045, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689970299174.6369aefa274a2c3b89e9054606b5b045.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp 2023-07-21 20:11:39,235 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689970299174.862fffd487c840233dd7c2f0f87615f0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 20:11:39,235 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing 862fffd487c840233dd7c2f0f87615f0, disabling compactions & flushes 2023-07-21 20:11:39,235 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689970299174.862fffd487c840233dd7c2f0f87615f0. 2023-07-21 20:11:39,235 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689970299174.862fffd487c840233dd7c2f0f87615f0. 2023-07-21 20:11:39,235 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689970299174.862fffd487c840233dd7c2f0f87615f0. after waiting 0 ms 2023-07-21 20:11:39,236 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689970299174.862fffd487c840233dd7c2f0f87615f0. 2023-07-21 20:11:39,236 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689970299174.862fffd487c840233dd7c2f0f87615f0. 2023-07-21 20:11:39,236 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for 862fffd487c840233dd7c2f0f87615f0: 2023-07-21 20:11:39,244 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689970299174.6369aefa274a2c3b89e9054606b5b045.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 20:11:39,244 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing 6369aefa274a2c3b89e9054606b5b045, disabling compactions & flushes 2023-07-21 20:11:39,244 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689970299174.6369aefa274a2c3b89e9054606b5b045. 2023-07-21 20:11:39,244 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689970299174.6369aefa274a2c3b89e9054606b5b045. 2023-07-21 20:11:39,244 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689970299174.6369aefa274a2c3b89e9054606b5b045. after waiting 0 ms 2023-07-21 20:11:39,244 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689970299174.6369aefa274a2c3b89e9054606b5b045. 2023-07-21 20:11:39,244 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689970299174.6369aefa274a2c3b89e9054606b5b045. 2023-07-21 20:11:39,244 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for 6369aefa274a2c3b89e9054606b5b045: 2023-07-21 20:11:39,247 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-07-21 20:11:39,248 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689970299174.862fffd487c840233dd7c2f0f87615f0.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689970299248"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689970299248"}]},"ts":"1689970299248"} 2023-07-21 20:11:39,248 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689970299174.6369aefa274a2c3b89e9054606b5b045.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689970299248"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689970299248"}]},"ts":"1689970299248"} 2023-07-21 20:11:39,256 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-21 20:11:39,257 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-21 20:11:39,257 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689970299257"}]},"ts":"1689970299257"} 2023-07-21 20:11:39,258 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-07-21 20:11:39,262 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-21 20:11:39,264 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-21 20:11:39,264 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-21 20:11:39,264 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-21 20:11:39,264 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-21 20:11:39,264 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=862fffd487c840233dd7c2f0f87615f0, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=6369aefa274a2c3b89e9054606b5b045, ASSIGN}] 2023-07-21 20:11:39,267 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=6369aefa274a2c3b89e9054606b5b045, ASSIGN 2023-07-21 20:11:39,267 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=862fffd487c840233dd7c2f0f87615f0, ASSIGN 2023-07-21 20:11:39,268 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=6369aefa274a2c3b89e9054606b5b045, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34071,1689970216065; forceNewPlan=false, retain=false 2023-07-21 20:11:39,268 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=862fffd487c840233dd7c2f0f87615f0, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40099,1689970215928; forceNewPlan=false, retain=false 2023-07-21 20:11:39,284 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-21 20:11:39,418 INFO [jenkins-hbase4:41777] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-21 20:11:39,421 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=862fffd487c840233dd7c2f0f87615f0, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:11:39,421 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=6369aefa274a2c3b89e9054606b5b045, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:11:39,421 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689970299174.862fffd487c840233dd7c2f0f87615f0.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689970299421"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689970299421"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689970299421"}]},"ts":"1689970299421"} 2023-07-21 20:11:39,421 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689970299174.6369aefa274a2c3b89e9054606b5b045.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689970299421"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689970299421"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689970299421"}]},"ts":"1689970299421"} 2023-07-21 20:11:39,423 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE; OpenRegionProcedure 6369aefa274a2c3b89e9054606b5b045, server=jenkins-hbase4.apache.org,34071,1689970216065}] 2023-07-21 20:11:39,425 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=58, state=RUNNABLE; OpenRegionProcedure 862fffd487c840233dd7c2f0f87615f0, server=jenkins-hbase4.apache.org,40099,1689970215928}] 2023-07-21 20:11:39,486 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-21 20:11:39,580 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1689970299174.6369aefa274a2c3b89e9054606b5b045. 2023-07-21 20:11:39,581 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6369aefa274a2c3b89e9054606b5b045, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689970299174.6369aefa274a2c3b89e9054606b5b045.', STARTKEY => '1', ENDKEY => ''} 2023-07-21 20:11:39,581 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1689970299174.6369aefa274a2c3b89e9054606b5b045. service=AccessControlService 2023-07-21 20:11:39,581 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 20:11:39,582 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 6369aefa274a2c3b89e9054606b5b045 2023-07-21 20:11:39,583 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689970299174.6369aefa274a2c3b89e9054606b5b045.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 20:11:39,583 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 6369aefa274a2c3b89e9054606b5b045 2023-07-21 20:11:39,583 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 6369aefa274a2c3b89e9054606b5b045 2023-07-21 20:11:39,584 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1689970299174.862fffd487c840233dd7c2f0f87615f0. 2023-07-21 20:11:39,584 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 862fffd487c840233dd7c2f0f87615f0, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689970299174.862fffd487c840233dd7c2f0f87615f0.', STARTKEY => '', ENDKEY => '1'} 2023-07-21 20:11:39,584 INFO [StoreOpener-6369aefa274a2c3b89e9054606b5b045-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 6369aefa274a2c3b89e9054606b5b045 2023-07-21 20:11:39,584 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1689970299174.862fffd487c840233dd7c2f0f87615f0. service=AccessControlService 2023-07-21 20:11:39,585 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 20:11:39,585 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 862fffd487c840233dd7c2f0f87615f0 2023-07-21 20:11:39,585 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689970299174.862fffd487c840233dd7c2f0f87615f0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 20:11:39,585 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 862fffd487c840233dd7c2f0f87615f0 2023-07-21 20:11:39,585 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 862fffd487c840233dd7c2f0f87615f0 2023-07-21 20:11:39,586 DEBUG [StoreOpener-6369aefa274a2c3b89e9054606b5b045-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testExportFileSystemStateWithMergeRegion/6369aefa274a2c3b89e9054606b5b045/cf 2023-07-21 20:11:39,586 DEBUG [StoreOpener-6369aefa274a2c3b89e9054606b5b045-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testExportFileSystemStateWithMergeRegion/6369aefa274a2c3b89e9054606b5b045/cf 2023-07-21 20:11:39,587 INFO [StoreOpener-862fffd487c840233dd7c2f0f87615f0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 862fffd487c840233dd7c2f0f87615f0 2023-07-21 20:11:39,587 INFO [StoreOpener-6369aefa274a2c3b89e9054606b5b045-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6369aefa274a2c3b89e9054606b5b045 columnFamilyName cf 2023-07-21 20:11:39,592 DEBUG [StoreOpener-862fffd487c840233dd7c2f0f87615f0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testExportFileSystemStateWithMergeRegion/862fffd487c840233dd7c2f0f87615f0/cf 2023-07-21 20:11:39,592 DEBUG [StoreOpener-862fffd487c840233dd7c2f0f87615f0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testExportFileSystemStateWithMergeRegion/862fffd487c840233dd7c2f0f87615f0/cf 2023-07-21 20:11:39,592 INFO [StoreOpener-6369aefa274a2c3b89e9054606b5b045-1] regionserver.HStore(310): Store=6369aefa274a2c3b89e9054606b5b045/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 20:11:39,592 INFO [StoreOpener-862fffd487c840233dd7c2f0f87615f0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 862fffd487c840233dd7c2f0f87615f0 columnFamilyName cf 2023-07-21 20:11:39,593 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testExportFileSystemStateWithMergeRegion/6369aefa274a2c3b89e9054606b5b045 2023-07-21 20:11:39,593 INFO [StoreOpener-862fffd487c840233dd7c2f0f87615f0-1] regionserver.HStore(310): Store=862fffd487c840233dd7c2f0f87615f0/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 20:11:39,593 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testExportFileSystemStateWithMergeRegion/6369aefa274a2c3b89e9054606b5b045 2023-07-21 20:11:39,594 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testExportFileSystemStateWithMergeRegion/862fffd487c840233dd7c2f0f87615f0 2023-07-21 20:11:39,595 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testExportFileSystemStateWithMergeRegion/862fffd487c840233dd7c2f0f87615f0 2023-07-21 20:11:39,596 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 6369aefa274a2c3b89e9054606b5b045 2023-07-21 20:11:39,599 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testExportFileSystemStateWithMergeRegion/6369aefa274a2c3b89e9054606b5b045/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-21 20:11:39,599 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 6369aefa274a2c3b89e9054606b5b045; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68752591, jitterRate=0.024493440985679626}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-21 20:11:39,599 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 6369aefa274a2c3b89e9054606b5b045: 2023-07-21 20:11:39,599 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 862fffd487c840233dd7c2f0f87615f0 2023-07-21 20:11:39,600 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1689970299174.6369aefa274a2c3b89e9054606b5b045., pid=60, masterSystemTime=1689970299576 2023-07-21 20:11:39,601 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1689970299174.6369aefa274a2c3b89e9054606b5b045. 2023-07-21 20:11:39,602 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1689970299174.6369aefa274a2c3b89e9054606b5b045. 2023-07-21 20:11:39,602 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testExportFileSystemStateWithMergeRegion/862fffd487c840233dd7c2f0f87615f0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-21 20:11:39,603 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 862fffd487c840233dd7c2f0f87615f0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62980954, jitterRate=-0.06151065230369568}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-21 20:11:39,603 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 862fffd487c840233dd7c2f0f87615f0: 2023-07-21 20:11:39,603 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1689970299174.862fffd487c840233dd7c2f0f87615f0., pid=61, masterSystemTime=1689970299578 2023-07-21 20:11:39,603 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=6369aefa274a2c3b89e9054606b5b045, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:11:39,604 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689970299174.6369aefa274a2c3b89e9054606b5b045.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689970299603"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689970299603"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689970299603"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689970299603"}]},"ts":"1689970299603"} 2023-07-21 20:11:39,605 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1689970299174.862fffd487c840233dd7c2f0f87615f0. 2023-07-21 20:11:39,605 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1689970299174.862fffd487c840233dd7c2f0f87615f0. 2023-07-21 20:11:39,605 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=862fffd487c840233dd7c2f0f87615f0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:11:39,606 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689970299174.862fffd487c840233dd7c2f0f87615f0.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689970299605"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689970299605"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689970299605"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689970299605"}]},"ts":"1689970299605"} 2023-07-21 20:11:39,608 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=59 2023-07-21 20:11:39,608 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=59, state=SUCCESS; OpenRegionProcedure 6369aefa274a2c3b89e9054606b5b045, server=jenkins-hbase4.apache.org,34071,1689970216065 in 183 msec 2023-07-21 20:11:39,609 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=58 2023-07-21 20:11:39,609 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=6369aefa274a2c3b89e9054606b5b045, ASSIGN in 344 msec 2023-07-21 20:11:39,609 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=58, state=SUCCESS; OpenRegionProcedure 862fffd487c840233dd7c2f0f87615f0, server=jenkins-hbase4.apache.org,40099,1689970215928 in 182 msec 2023-07-21 20:11:39,611 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=58, resume processing ppid=57 2023-07-21 20:11:39,611 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=862fffd487c840233dd7c2f0f87615f0, ASSIGN in 345 msec 2023-07-21 20:11:39,612 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-21 20:11:39,612 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689970299612"}]},"ts":"1689970299612"} 2023-07-21 20:11:39,614 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-07-21 20:11:39,616 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-07-21 20:11:39,617 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-07-21 20:11:39,619 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37823] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-21 20:11:39,620 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 20:11:39,620 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 20:11:39,620 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 20:11:39,620 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 20:11:39,622 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-21 20:11:39,622 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-21 20:11:39,622 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-21 20:11:39,622 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-21 20:11:39,624 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 447 msec 2023-07-21 20:11:39,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-21 20:11:39,787 INFO [Listener at jenkins-hbase4.apache.org/38105] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-07-21 20:11:39,790 DEBUG [Listener at jenkins-hbase4.apache.org/38105] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:39,790 DEBUG [Listener at jenkins-hbase4.apache.org/38105] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1689970299174.862fffd487c840233dd7c2f0f87615f0. 2023-07-21 20:11:39,792 INFO [Listener at jenkins-hbase4.apache.org/38105] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-21 20:11:39,805 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-21 20:11:39,805 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689970299805 (current time:1689970299805). 2023-07-21 20:11:39,805 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-21 20:11:39,806 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] zookeeper.ReadOnlyZKClient(139): Connect 0x0a4fe10e to 127.0.0.1:59101 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 20:11:39,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3c00ae1a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 20:11:39,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 20:11:39,817 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45964, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 20:11:39,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0a4fe10e to 127.0.0.1:59101 2023-07-21 20:11:39,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 20:11:39,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] zookeeper.ReadOnlyZKClient(139): Connect 0x7557b1df to 127.0.0.1:59101 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 20:11:39,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@e569ea, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 20:11:39,825 DEBUG [hconnection-0x39ac7792-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 20:11:39,826 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45972, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 20:11:39,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 20:11:39,832 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34348, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 20:11:39,833 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7557b1df to 127.0.0.1:59101 2023-07-21 20:11:39,834 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 20:11:39,834 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-21 20:11:39,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-21 20:11:39,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-21 20:11:39,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] procedure2.ProcedureExecutor(1029): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-21 20:11:39,838 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-21 20:11:39,839 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689970899839 2023-07-21 20:11:39,839 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:39,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-21 20:11:39,841 DEBUG [Listener at jenkins-hbase4.apache.org/38105] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-21 20:11:39,841 DEBUG [Listener at jenkins-hbase4.apache.org/38105] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-21 20:11:39,842 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-21 20:11:39,842 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-21 20:11:39,844 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 6 msec 2023-07-21 20:11:39,844 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-21 20:11:39,845 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689970899845 2023-07-21 20:11:39,869 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:39,869 INFO [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-21 20:11:39,869 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 20:11:39,870 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-21 20:11:39,870 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-21 20:11:39,938 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:39,938 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:39,940 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:11:39,940 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:11:39,940 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:11:39,940 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:11:39,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:11:39,940 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:11:39,940 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:11:39,940 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:11:39,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:11:39,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:11:39,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:39,940 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:11:39,941 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:11:39,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:39,941 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:39,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:39,941 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:11:39,941 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-21 20:11:39,941 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:39,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-21 20:11:39,941 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:39,941 DEBUG [Listener at jenkins-hbase4.apache.org/38105] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 20:11:39,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:39,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-21 20:11:39,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:39,941 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-21 20:11:39,942 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-21 20:11:39,942 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:39,942 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-21 20:11:39,942 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:39,942 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 20:11:39,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-21 20:11:39,943 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-21 20:11:39,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-21 20:11:39,942 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-21 20:11:39,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-21 20:11:39,943 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-21 20:11:39,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:39,944 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37823,1689970216018' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-21 20:11:39,943 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 20:11:39,944 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-21 20:11:39,944 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-21 20:11:39,945 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-21 20:11:39,944 DEBUG [Listener at jenkins-hbase4.apache.org/38105] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-21 20:11:39,945 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34071,1689970216065' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-21 20:11:39,945 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:39,945 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-21 20:11:39,945 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 20:11:39,946 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-21 20:11:39,946 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-21 20:11:39,946 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40099,1689970215928' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-21 20:11:39,947 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:39,948 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:39,948 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:39,948 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 20:11:39,951 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:11:39,951 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:11:39,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:11:39,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 20:11:39,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 20:11:39,953 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:39,953 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:39,954 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 20:11:39,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 20:11:39,954 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:39,954 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 20:11:39,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 20:11:39,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:39,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:11:39,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:11:39,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:11:39,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 20:11:39,956 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34071,1689970216065' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-21 20:11:39,956 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@57d4418c[Count = 1] remaining members to acquire global barrier 2023-07-21 20:11:39,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:11:39,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 20:11:39,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 20:11:39,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 20:11:39,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 20:11:39,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:39,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:11:39,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:11:39,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:11:39,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 20:11:39,958 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40099,1689970215928' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-21 20:11:39,958 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@57d4418c[Count = 0] remaining members to acquire global barrier 2023-07-21 20:11:39,958 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-21 20:11:39,958 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:39,959 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:39,959 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:39,959 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:39,959 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:39,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:39,959 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:39,960 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:11:39,960 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:39,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:39,960 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-21 20:11:39,960 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-21 20:11:39,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:39,960 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-21 20:11:39,960 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-21 20:11:39,960 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,37823,1689970216018' in zk 2023-07-21 20:11:39,960 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:11:39,960 DEBUG [rs(jenkins-hbase4.apache.org,34071,1689970216065)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689970299174.6369aefa274a2c3b89e9054606b5b045. 2023-07-21 20:11:39,960 DEBUG [rs(jenkins-hbase4.apache.org,40099,1689970215928)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689970299174.862fffd487c840233dd7c2f0f87615f0. 2023-07-21 20:11:39,960 DEBUG [rs(jenkins-hbase4.apache.org,34071,1689970216065)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689970299174.6369aefa274a2c3b89e9054606b5b045. started... 2023-07-21 20:11:39,960 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 20:11:39,960 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 20:11:39,960 DEBUG [rs(jenkins-hbase4.apache.org,40099,1689970215928)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689970299174.862fffd487c840233dd7c2f0f87615f0. started... 2023-07-21 20:11:39,960 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 20:11:39,962 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 20:11:39,960 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-21 20:11:39,962 DEBUG [rs(jenkins-hbase4.apache.org,40099,1689970215928)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 862fffd487c840233dd7c2f0f87615f0: 2023-07-21 20:11:39,962 DEBUG [rs(jenkins-hbase4.apache.org,34071,1689970216065)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6369aefa274a2c3b89e9054606b5b045: 2023-07-21 20:11:39,962 DEBUG [rs(jenkins-hbase4.apache.org,40099,1689970215928)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689970299174.862fffd487c840233dd7c2f0f87615f0.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:39,962 DEBUG [rs(jenkins-hbase4.apache.org,40099,1689970215928)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 20:11:39,962 DEBUG [rs(jenkins-hbase4.apache.org,40099,1689970215928)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-21 20:11:39,962 DEBUG [rs(jenkins-hbase4.apache.org,34071,1689970216065)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689970299174.6369aefa274a2c3b89e9054606b5b045.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:39,962 DEBUG [rs(jenkins-hbase4.apache.org,34071,1689970216065)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 20:11:39,962 DEBUG [rs(jenkins-hbase4.apache.org,34071,1689970216065)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-21 20:11:39,970 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-21 20:11:39,970 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 20:11:39,970 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-21 20:11:39,983 DEBUG [rs(jenkins-hbase4.apache.org,40099,1689970215928)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689970299174.862fffd487c840233dd7c2f0f87615f0. completed. 2023-07-21 20:11:39,984 DEBUG [rs(jenkins-hbase4.apache.org,40099,1689970215928)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689970299174.862fffd487c840233dd7c2f0f87615f0. 2023-07-21 20:11:39,984 DEBUG [rs(jenkins-hbase4.apache.org,34071,1689970216065)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689970299174.6369aefa274a2c3b89e9054606b5b045. completed. 2023-07-21 20:11:39,984 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 20:11:39,984 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 20:11:39,984 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:11:39,984 DEBUG [rs(jenkins-hbase4.apache.org,34071,1689970216065)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689970299174.6369aefa274a2c3b89e9054606b5b045. 2023-07-21 20:11:39,984 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-21 20:11:39,984 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,40099,1689970215928' in zk 2023-07-21 20:11:39,984 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 20:11:39,984 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 20:11:39,984 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:11:39,984 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-21 20:11:39,984 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,34071,1689970216065' in zk 2023-07-21 20:11:39,986 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:11:39,986 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:11:39,986 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-21 20:11:39,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:11:39,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 20:11:39,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 20:11:39,986 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 20:11:39,986 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-21 20:11:39,987 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-21 20:11:39,987 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 20:11:39,987 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-21 20:11:39,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 20:11:39,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 20:11:39,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:39,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:11:39,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:11:39,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:11:39,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 20:11:39,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:39,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:11:39,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:11:39,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:11:39,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,40099,1689970215928': 2023-07-21 20:11:39,992 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40099,1689970215928' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-21 20:11:39,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:11:39,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 20:11:39,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 20:11:39,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 20:11:39,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 20:11:39,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:39,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:11:39,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:11:39,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:11:39,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 20:11:39,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:39,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:11:39,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:11:39,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:11:39,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,34071,1689970216065': 2023-07-21 20:11:39,999 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34071,1689970216065' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-21 20:11:39,999 INFO [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-21 20:11:39,999 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-21 20:11:39,999 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-21 20:11:39,999 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:39,999 INFO [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-21 20:11:40,001 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:40,001 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:40,001 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:40,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:40,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 20:11:40,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 20:11:40,001 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:40,002 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:11:40,002 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:40,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:40,001 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:40,002 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:11:40,002 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:40,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:40,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:40,001 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:11:40,002 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:11:40,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:11:40,003 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:11:40,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:11:40,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:40,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 20:11:40,003 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:11:40,003 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:11:40,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:11:40,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:40,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:40,004 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:11:40,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:40,004 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:11:40,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 20:11:40,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:40,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:11:40,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:11:40,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:11:40,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 20:11:40,006 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:11:40,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:40,006 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:11:40,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:11:40,007 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:11:40,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:11:40,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:11:40,010 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:11:40,010 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:11:40,010 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:11:40,010 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:11:40,010 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:11:40,010 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:11:40,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:11:40,010 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:40,010 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:11:40,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:11:40,010 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 20:11:40,010 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:11:40,010 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:40,012 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:11:40,011 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:40,011 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:11:40,012 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:11:40,011 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:11:40,013 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:11:40,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:11:40,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:11:40,013 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:40,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:11:40,012 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:11:40,013 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-21 20:11:40,013 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:40,013 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:11:40,013 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:40,013 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:11:40,013 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:11:40,013 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:40,013 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:40,014 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:11:40,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:11:40,014 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-21 20:11:40,029 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:40,030 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:40,049 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:40,073 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-21 20:11:40,074 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:40,074 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:40,074 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689970299839Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1689970300029 (+190 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689970300029Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689970300029Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689970300033 (+4 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689970300043 (+10 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689970300073 (+30 ms) 2023-07-21 20:11:40,079 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-21 20:11:40,085 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 240 msec 2023-07-21 20:11:40,145 DEBUG [Listener at jenkins-hbase4.apache.org/38105] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 20:11:40,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-21 20:11:40,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-21 20:11:40,150 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1689970299174.862fffd487c840233dd7c2f0f87615f0. with WAL disabled. Data may be lost in the event of a crash. 2023-07-21 20:11:40,154 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34071] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1689970299174.6369aefa274a2c3b89e9054606b5b045. with WAL disabled. Data may be lost in the event of a crash. 2023-07-21 20:11:40,158 DEBUG [Listener at jenkins-hbase4.apache.org/38105] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:40,158 DEBUG [Listener at jenkins-hbase4.apache.org/38105] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1689970299174.862fffd487c840233dd7c2f0f87615f0. 2023-07-21 20:11:40,158 INFO [Listener at jenkins-hbase4.apache.org/38105] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-21 20:11:40,169 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-21 20:11:40,169 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689970300169 (current time:1689970300169). 2023-07-21 20:11:40,169 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-21 20:11:40,170 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] zookeeper.ReadOnlyZKClient(139): Connect 0x6d9004ae to 127.0.0.1:59101 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 20:11:40,179 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6ea27f3c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 20:11:40,180 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 20:11:40,183 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45980, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 20:11:40,184 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6d9004ae to 127.0.0.1:59101 2023-07-21 20:11:40,184 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 20:11:40,185 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] zookeeper.ReadOnlyZKClient(139): Connect 0x490634d2 to 127.0.0.1:59101 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 20:11:40,191 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@24defc28, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 20:11:40,192 DEBUG [hconnection-0x59783c10-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 20:11:40,195 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45990, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 20:11:40,199 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 20:11:40,201 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34358, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 20:11:40,202 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x490634d2 to 127.0.0.1:59101 2023-07-21 20:11:40,202 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 20:11:40,202 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-21 20:11:40,203 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-21 20:11:40,203 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-21 20:11:40,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-21 20:11:40,206 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-21 20:11:40,207 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689970900207 2023-07-21 20:11:40,207 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-21 20:11:40,207 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:40,209 DEBUG [Listener at jenkins-hbase4.apache.org/38105] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-21 20:11:40,209 DEBUG [Listener at jenkins-hbase4.apache.org/38105] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-21 20:11:40,209 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-21 20:11:40,209 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-21 20:11:40,211 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 5 msec 2023-07-21 20:11:40,211 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-21 20:11:40,212 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689970900212 2023-07-21 20:11:40,226 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:40,227 INFO [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-21 20:11:40,227 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 20:11:40,228 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-21 20:11:40,228 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-21 20:11:40,229 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:40,229 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:40,231 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:11:40,231 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:11:40,231 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:11:40,231 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:11:40,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:11:40,231 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:11:40,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:11:40,231 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:11:40,231 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:11:40,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:11:40,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:40,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:40,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:40,232 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:40,232 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:40,232 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:11:40,232 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:11:40,232 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:40,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-21 20:11:40,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:40,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-21 20:11:40,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:40,232 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:11:40,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-21 20:11:40,233 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-21 20:11:40,232 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-21 20:11:40,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:40,233 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-21 20:11:40,233 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-21 20:11:40,233 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:40,233 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:40,233 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-21 20:11:40,233 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-21 20:11:40,233 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:40,233 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 20:11:40,233 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-21 20:11:40,233 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 20:11:40,234 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 20:11:40,234 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-21 20:11:40,237 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-21 20:11:40,237 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-21 20:11:40,235 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-21 20:11:40,237 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40099,1689970215928' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-21 20:11:40,237 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-21 20:11:40,237 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34071,1689970216065' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-21 20:11:40,237 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-21 20:11:40,237 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37823,1689970216018' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-21 20:11:40,239 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:11:40,239 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:40,239 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:40,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:11:40,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 20:11:40,239 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:11:40,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 20:11:40,239 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:40,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 20:11:40,239 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:40,239 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 20:11:40,239 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:40,240 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 20:11:40,240 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:40,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 20:11:40,240 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 20:11:40,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:40,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:11:40,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:11:40,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:11:40,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 20:11:40,241 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40099,1689970215928' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-21 20:11:40,241 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@62b5e347[Count = 1] remaining members to acquire global barrier 2023-07-21 20:11:40,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:11:40,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 20:11:40,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 20:11:40,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 20:11:40,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 20:11:40,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:40,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:11:40,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:11:40,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:11:40,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 20:11:40,244 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34071,1689970216065' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-21 20:11:40,244 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@62b5e347[Count = 0] remaining members to acquire global barrier 2023-07-21 20:11:40,244 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-21 20:11:40,244 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:40,245 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:40,245 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:40,245 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:40,245 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:40,245 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:40,245 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:40,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:40,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:40,246 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-21 20:11:40,246 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-21 20:11:40,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:40,246 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-21 20:11:40,246 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:11:40,246 DEBUG [rs(jenkins-hbase4.apache.org,40099,1689970215928)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689970299174.862fffd487c840233dd7c2f0f87615f0. 2023-07-21 20:11:40,246 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,37823,1689970216018' in zk 2023-07-21 20:11:40,246 DEBUG [rs(jenkins-hbase4.apache.org,40099,1689970215928)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689970299174.862fffd487c840233dd7c2f0f87615f0. started... 2023-07-21 20:11:40,246 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-21 20:11:40,246 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 20:11:40,246 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 20:11:40,246 INFO [rs(jenkins-hbase4.apache.org,40099,1689970215928)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 862fffd487c840233dd7c2f0f87615f0 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-21 20:11:40,246 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 20:11:40,246 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:11:40,246 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-21 20:11:40,246 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 20:11:40,246 DEBUG [rs(jenkins-hbase4.apache.org,34071,1689970216065)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689970299174.6369aefa274a2c3b89e9054606b5b045. 2023-07-21 20:11:40,247 DEBUG [rs(jenkins-hbase4.apache.org,34071,1689970216065)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689970299174.6369aefa274a2c3b89e9054606b5b045. started... 2023-07-21 20:11:40,247 INFO [rs(jenkins-hbase4.apache.org,34071,1689970216065)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 6369aefa274a2c3b89e9054606b5b045 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-21 20:11:40,249 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-21 20:11:40,249 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 20:11:40,249 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-21 20:11:40,292 INFO [rs(jenkins-hbase4.apache.org,40099,1689970215928)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230721aeff53aabe654049b9ad4fdc39c36330 to hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230721aeff53aabe654049b9ad4fdc39c36330 2023-07-21 20:11:40,296 INFO [rs(jenkins-hbase4.apache.org,34071,1689970216065)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202307215a832739023f4623a63b9fb16a8dceea to hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202307215a832739023f4623a63b9fb16a8dceea 2023-07-21 20:11:40,309 DEBUG [Listener at jenkins-hbase4.apache.org/38105] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 20:11:40,310 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-21 20:11:40,310 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-21 20:11:40,310 DEBUG [Listener at jenkins-hbase4.apache.org/38105] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-21 20:11:40,315 INFO [rs(jenkins-hbase4.apache.org,40099,1689970215928)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testExportFileSystemStateWithMergeRegion/862fffd487c840233dd7c2f0f87615f0/.tmp/cf/2a580da1a1ea4d9483596483bc1a1b56 2023-07-21 20:11:40,322 INFO [rs(jenkins-hbase4.apache.org,34071,1689970216065)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testExportFileSystemStateWithMergeRegion/6369aefa274a2c3b89e9054606b5b045/.tmp/cf/689f7b51033f40daad00e0bf3eee0ec1 2023-07-21 20:11:40,323 DEBUG [rs(jenkins-hbase4.apache.org,40099,1689970215928)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testExportFileSystemStateWithMergeRegion/862fffd487c840233dd7c2f0f87615f0/.tmp/cf/2a580da1a1ea4d9483596483bc1a1b56 as hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testExportFileSystemStateWithMergeRegion/862fffd487c840233dd7c2f0f87615f0/cf/2a580da1a1ea4d9483596483bc1a1b56 2023-07-21 20:11:40,329 DEBUG [rs(jenkins-hbase4.apache.org,34071,1689970216065)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testExportFileSystemStateWithMergeRegion/6369aefa274a2c3b89e9054606b5b045/.tmp/cf/689f7b51033f40daad00e0bf3eee0ec1 as hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testExportFileSystemStateWithMergeRegion/6369aefa274a2c3b89e9054606b5b045/cf/689f7b51033f40daad00e0bf3eee0ec1 2023-07-21 20:11:40,331 INFO [rs(jenkins-hbase4.apache.org,40099,1689970215928)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testExportFileSystemStateWithMergeRegion/862fffd487c840233dd7c2f0f87615f0/cf/2a580da1a1ea4d9483596483bc1a1b56, entries=4, sequenceid=6, filesize=5.6 K 2023-07-21 20:11:40,332 INFO [rs(jenkins-hbase4.apache.org,40099,1689970215928)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 862fffd487c840233dd7c2f0f87615f0 in 86ms, sequenceid=6, compaction requested=false 2023-07-21 20:11:40,332 DEBUG [rs(jenkins-hbase4.apache.org,40099,1689970215928)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-07-21 20:11:40,333 DEBUG [rs(jenkins-hbase4.apache.org,40099,1689970215928)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 862fffd487c840233dd7c2f0f87615f0: 2023-07-21 20:11:40,333 DEBUG [rs(jenkins-hbase4.apache.org,40099,1689970215928)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689970299174.862fffd487c840233dd7c2f0f87615f0.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:40,333 DEBUG [rs(jenkins-hbase4.apache.org,40099,1689970215928)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 20:11:40,333 DEBUG [rs(jenkins-hbase4.apache.org,40099,1689970215928)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testExportFileSystemStateWithMergeRegion/862fffd487c840233dd7c2f0f87615f0/cf/2a580da1a1ea4d9483596483bc1a1b56] hfiles 2023-07-21 20:11:40,333 DEBUG [rs(jenkins-hbase4.apache.org,40099,1689970215928)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testExportFileSystemStateWithMergeRegion/862fffd487c840233dd7c2f0f87615f0/cf/2a580da1a1ea4d9483596483bc1a1b56 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:40,337 INFO [rs(jenkins-hbase4.apache.org,34071,1689970216065)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testExportFileSystemStateWithMergeRegion/6369aefa274a2c3b89e9054606b5b045/cf/689f7b51033f40daad00e0bf3eee0ec1, entries=46, sequenceid=6, filesize=13.3 K 2023-07-21 20:11:40,339 INFO [rs(jenkins-hbase4.apache.org,34071,1689970216065)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 6369aefa274a2c3b89e9054606b5b045 in 92ms, sequenceid=6, compaction requested=false 2023-07-21 20:11:40,341 DEBUG [rs(jenkins-hbase4.apache.org,34071,1689970216065)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6369aefa274a2c3b89e9054606b5b045: 2023-07-21 20:11:40,341 DEBUG [rs(jenkins-hbase4.apache.org,34071,1689970216065)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689970299174.6369aefa274a2c3b89e9054606b5b045.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:40,341 DEBUG [rs(jenkins-hbase4.apache.org,34071,1689970216065)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 20:11:40,341 DEBUG [rs(jenkins-hbase4.apache.org,34071,1689970216065)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testExportFileSystemStateWithMergeRegion/6369aefa274a2c3b89e9054606b5b045/cf/689f7b51033f40daad00e0bf3eee0ec1] hfiles 2023-07-21 20:11:40,341 DEBUG [rs(jenkins-hbase4.apache.org,34071,1689970216065)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testExportFileSystemStateWithMergeRegion/6369aefa274a2c3b89e9054606b5b045/cf/689f7b51033f40daad00e0bf3eee0ec1 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:40,367 DEBUG [rs(jenkins-hbase4.apache.org,40099,1689970215928)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689970299174.862fffd487c840233dd7c2f0f87615f0. completed. 2023-07-21 20:11:40,367 DEBUG [rs(jenkins-hbase4.apache.org,40099,1689970215928)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689970299174.862fffd487c840233dd7c2f0f87615f0. 2023-07-21 20:11:40,367 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 20:11:40,368 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 20:11:40,368 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:11:40,368 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-21 20:11:40,368 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,40099,1689970215928' in zk 2023-07-21 20:11:40,370 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-21 20:11:40,371 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:11:40,371 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 20:11:40,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:11:40,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 20:11:40,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 20:11:40,373 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-21 20:11:40,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 20:11:40,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 20:11:40,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:40,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:11:40,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:11:40,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:11:40,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 20:11:40,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:40,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:11:40,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:11:40,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,40099,1689970215928': 2023-07-21 20:11:40,380 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40099,1689970215928' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-21 20:11:40,381 DEBUG [rs(jenkins-hbase4.apache.org,34071,1689970216065)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689970299174.6369aefa274a2c3b89e9054606b5b045. completed. 2023-07-21 20:11:40,381 DEBUG [rs(jenkins-hbase4.apache.org,34071,1689970216065)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689970299174.6369aefa274a2c3b89e9054606b5b045. 2023-07-21 20:11:40,381 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 20:11:40,381 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 20:11:40,382 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:11:40,382 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-21 20:11:40,382 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,34071,1689970216065' in zk 2023-07-21 20:11:40,383 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:11:40,383 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-21 20:11:40,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:11:40,383 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 20:11:40,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 20:11:40,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 20:11:40,384 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-21 20:11:40,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 20:11:40,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 20:11:40,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:40,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:11:40,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:11:40,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:11:40,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 20:11:40,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:40,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:11:40,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:11:40,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:11:40,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,34071,1689970216065': 2023-07-21 20:11:40,391 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34071,1689970216065' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-21 20:11:40,391 INFO [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-21 20:11:40,391 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-21 20:11:40,391 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-21 20:11:40,391 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:40,391 INFO [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-21 20:11:40,399 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:40,399 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:40,399 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:40,399 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:11:40,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:40,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 20:11:40,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 20:11:40,399 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:40,399 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:11:40,399 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:11:40,399 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:40,399 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:40,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:40,399 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:40,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:40,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:40,400 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:11:40,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:11:40,400 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:11:40,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:11:40,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 20:11:40,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:40,401 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:11:40,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:11:40,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:40,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:40,401 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:11:40,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:40,402 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:11:40,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 20:11:40,402 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:11:40,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:40,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:11:40,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:11:40,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:11:40,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 20:11:40,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:40,410 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:11:40,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:11:40,411 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:11:40,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:11:40,412 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:11:40,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:11:40,416 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:11:40,416 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:11:40,416 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:11:40,416 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:11:40,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:11:40,416 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:11:40,417 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:11:40,416 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:11:40,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:11:40,417 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:11:40,417 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:11:40,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:11:40,417 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:11:40,417 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:11:40,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:11:40,417 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 20:11:40,417 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:40,419 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:40,417 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:40,419 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:40,419 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:11:40,417 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:11:40,420 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:11:40,420 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:40,420 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:11:40,420 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:40,420 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:11:40,420 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-21 20:11:40,420 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:11:40,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:11:40,420 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:11:40,420 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:40,420 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:40,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:11:40,421 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202307215a832739023f4623a63b9fb16a8dceea, hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230721aeff53aabe654049b9ad4fdc39c36330] mob files 2023-07-21 20:11:40,421 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202307215a832739023f4623a63b9fb16a8dceea 2023-07-21 20:11:40,421 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230721aeff53aabe654049b9ad4fdc39c36330 2023-07-21 20:11:40,458 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:40,459 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:40,496 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:40,511 DEBUG [Listener at jenkins-hbase4.apache.org/38105] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 20:11:40,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-21 20:11:40,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-21 20:11:40,512 DEBUG [Listener at jenkins-hbase4.apache.org/38105] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-21 20:11:40,570 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-21 20:11:40,571 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:40,572 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:40,572 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689970300207Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1689970300458 (+251 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689970300458Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1689970300458Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1689970300465 (+7 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689970300475 (+10 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689970300570 (+95 ms) 2023-07-21 20:11:40,575 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-21 20:11:40,578 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 367 msec 2023-07-21 20:11:40,812 DEBUG [Listener at jenkins-hbase4.apache.org/38105] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 20:11:40,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-21 20:11:40,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-21 20:11:40,843 DEBUG [Listener at jenkins-hbase4.apache.org/38105] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-21 20:11:40,848 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56430, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-21 20:11:40,850 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34071] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-21 20:11:40,850 DEBUG [Listener at jenkins-hbase4.apache.org/38105] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-21 20:11:40,853 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56940, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-21 20:11:40,853 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37823] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-21 20:11:40,853 DEBUG [Listener at jenkins-hbase4.apache.org/38105] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-21 20:11:40,855 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59668, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-21 20:11:40,856 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-21 20:11:40,858 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-21 20:11:40,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] procedure2.ProcedureExecutor(1029): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:40,860 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-07-21 20:11:40,861 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-07-21 20:11:40,861 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-21 20:11:40,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-21 20:11:40,864 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f90401a9c06a225e368cc626aba8722a 2023-07-21 20:11:40,864 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/67263990a032d97a21e9d2f7114be1cc 2023-07-21 20:11:40,864 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f90401a9c06a225e368cc626aba8722a empty. 2023-07-21 20:11:40,864 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/67263990a032d97a21e9d2f7114be1cc empty. 2023-07-21 20:11:40,865 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f90401a9c06a225e368cc626aba8722a 2023-07-21 20:11:40,865 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/67263990a032d97a21e9d2f7114be1cc 2023-07-21 20:11:40,865 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-21 20:11:40,877 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-07-21 20:11:40,878 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => f90401a9c06a225e368cc626aba8722a, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689970300857.f90401a9c06a225e368cc626aba8722a.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp 2023-07-21 20:11:40,878 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => 67263990a032d97a21e9d2f7114be1cc, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689970300857.67263990a032d97a21e9d2f7114be1cc.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp 2023-07-21 20:11:40,903 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689970300857.f90401a9c06a225e368cc626aba8722a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 20:11:40,903 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing f90401a9c06a225e368cc626aba8722a, disabling compactions & flushes 2023-07-21 20:11:40,903 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689970300857.f90401a9c06a225e368cc626aba8722a. 2023-07-21 20:11:40,903 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689970300857.f90401a9c06a225e368cc626aba8722a. 2023-07-21 20:11:40,903 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689970300857.f90401a9c06a225e368cc626aba8722a. after waiting 0 ms 2023-07-21 20:11:40,903 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689970300857.f90401a9c06a225e368cc626aba8722a. 2023-07-21 20:11:40,903 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689970300857.f90401a9c06a225e368cc626aba8722a. 2023-07-21 20:11:40,903 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for f90401a9c06a225e368cc626aba8722a: 2023-07-21 20:11:40,907 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689970300857.67263990a032d97a21e9d2f7114be1cc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 20:11:40,907 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing 67263990a032d97a21e9d2f7114be1cc, disabling compactions & flushes 2023-07-21 20:11:40,907 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689970300857.67263990a032d97a21e9d2f7114be1cc. 2023-07-21 20:11:40,907 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689970300857.67263990a032d97a21e9d2f7114be1cc. 2023-07-21 20:11:40,907 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689970300857.67263990a032d97a21e9d2f7114be1cc. after waiting 0 ms 2023-07-21 20:11:40,907 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689970300857.67263990a032d97a21e9d2f7114be1cc. 2023-07-21 20:11:40,907 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689970300857.67263990a032d97a21e9d2f7114be1cc. 2023-07-21 20:11:40,907 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for 67263990a032d97a21e9d2f7114be1cc: 2023-07-21 20:11:40,910 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-07-21 20:11:40,911 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689970300857.f90401a9c06a225e368cc626aba8722a.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689970300911"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689970300911"}]},"ts":"1689970300911"} 2023-07-21 20:11:40,911 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689970300857.67263990a032d97a21e9d2f7114be1cc.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689970300911"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689970300911"}]},"ts":"1689970300911"} 2023-07-21 20:11:40,913 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-21 20:11:40,914 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-21 20:11:40,914 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689970300914"}]},"ts":"1689970300914"} 2023-07-21 20:11:40,916 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-07-21 20:11:40,919 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-21 20:11:40,920 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-21 20:11:40,920 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-21 20:11:40,920 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-21 20:11:40,920 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-21 20:11:40,921 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f90401a9c06a225e368cc626aba8722a, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=67263990a032d97a21e9d2f7114be1cc, ASSIGN}] 2023-07-21 20:11:40,924 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f90401a9c06a225e368cc626aba8722a, ASSIGN 2023-07-21 20:11:40,924 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=67263990a032d97a21e9d2f7114be1cc, ASSIGN 2023-07-21 20:11:40,925 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f90401a9c06a225e368cc626aba8722a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34071,1689970216065; forceNewPlan=false, retain=false 2023-07-21 20:11:40,925 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=67263990a032d97a21e9d2f7114be1cc, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37823,1689970216018; forceNewPlan=false, retain=false 2023-07-21 20:11:40,964 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-21 20:11:41,075 INFO [jenkins-hbase4:41777] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-21 20:11:41,078 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=67263990a032d97a21e9d2f7114be1cc, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:11:41,078 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689970300857.67263990a032d97a21e9d2f7114be1cc.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689970301078"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689970301078"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689970301078"}]},"ts":"1689970301078"} 2023-07-21 20:11:41,079 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=f90401a9c06a225e368cc626aba8722a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:11:41,079 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689970300857.f90401a9c06a225e368cc626aba8722a.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689970301079"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689970301079"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689970301079"}]},"ts":"1689970301079"} 2023-07-21 20:11:41,081 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=68, state=RUNNABLE; OpenRegionProcedure 67263990a032d97a21e9d2f7114be1cc, server=jenkins-hbase4.apache.org,37823,1689970216018}] 2023-07-21 20:11:41,084 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=70, ppid=67, state=RUNNABLE; OpenRegionProcedure f90401a9c06a225e368cc626aba8722a, server=jenkins-hbase4.apache.org,34071,1689970216065}] 2023-07-21 20:11:41,165 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-21 20:11:41,236 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1689970300857.67263990a032d97a21e9d2f7114be1cc. 2023-07-21 20:11:41,236 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 67263990a032d97a21e9d2f7114be1cc, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689970300857.67263990a032d97a21e9d2f7114be1cc.', STARTKEY => '2', ENDKEY => ''} 2023-07-21 20:11:41,237 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1689970300857.67263990a032d97a21e9d2f7114be1cc. service=AccessControlService 2023-07-21 20:11:41,238 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 20:11:41,238 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 67263990a032d97a21e9d2f7114be1cc 2023-07-21 20:11:41,238 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689970300857.67263990a032d97a21e9d2f7114be1cc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 20:11:41,238 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 67263990a032d97a21e9d2f7114be1cc 2023-07-21 20:11:41,238 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 67263990a032d97a21e9d2f7114be1cc 2023-07-21 20:11:41,239 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689970300857.f90401a9c06a225e368cc626aba8722a. 2023-07-21 20:11:41,239 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f90401a9c06a225e368cc626aba8722a, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689970300857.f90401a9c06a225e368cc626aba8722a.', STARTKEY => '', ENDKEY => '2'} 2023-07-21 20:11:41,240 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689970300857.f90401a9c06a225e368cc626aba8722a. service=AccessControlService 2023-07-21 20:11:41,240 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 20:11:41,241 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 f90401a9c06a225e368cc626aba8722a 2023-07-21 20:11:41,241 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689970300857.f90401a9c06a225e368cc626aba8722a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 20:11:41,241 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f90401a9c06a225e368cc626aba8722a 2023-07-21 20:11:41,241 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f90401a9c06a225e368cc626aba8722a 2023-07-21 20:11:41,242 INFO [StoreOpener-67263990a032d97a21e9d2f7114be1cc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 67263990a032d97a21e9d2f7114be1cc 2023-07-21 20:11:41,242 INFO [StoreOpener-f90401a9c06a225e368cc626aba8722a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region f90401a9c06a225e368cc626aba8722a 2023-07-21 20:11:41,245 DEBUG [StoreOpener-67263990a032d97a21e9d2f7114be1cc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/67263990a032d97a21e9d2f7114be1cc/cf 2023-07-21 20:11:41,245 DEBUG [StoreOpener-67263990a032d97a21e9d2f7114be1cc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/67263990a032d97a21e9d2f7114be1cc/cf 2023-07-21 20:11:41,246 INFO [StoreOpener-67263990a032d97a21e9d2f7114be1cc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 67263990a032d97a21e9d2f7114be1cc columnFamilyName cf 2023-07-21 20:11:41,247 INFO [StoreOpener-67263990a032d97a21e9d2f7114be1cc-1] regionserver.HStore(310): Store=67263990a032d97a21e9d2f7114be1cc/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 20:11:41,247 DEBUG [StoreOpener-f90401a9c06a225e368cc626aba8722a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f90401a9c06a225e368cc626aba8722a/cf 2023-07-21 20:11:41,247 DEBUG [StoreOpener-f90401a9c06a225e368cc626aba8722a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f90401a9c06a225e368cc626aba8722a/cf 2023-07-21 20:11:41,247 INFO [StoreOpener-f90401a9c06a225e368cc626aba8722a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f90401a9c06a225e368cc626aba8722a columnFamilyName cf 2023-07-21 20:11:41,248 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/67263990a032d97a21e9d2f7114be1cc 2023-07-21 20:11:41,248 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/67263990a032d97a21e9d2f7114be1cc 2023-07-21 20:11:41,249 INFO [StoreOpener-f90401a9c06a225e368cc626aba8722a-1] regionserver.HStore(310): Store=f90401a9c06a225e368cc626aba8722a/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 20:11:41,250 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f90401a9c06a225e368cc626aba8722a 2023-07-21 20:11:41,250 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f90401a9c06a225e368cc626aba8722a 2023-07-21 20:11:41,252 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 67263990a032d97a21e9d2f7114be1cc 2023-07-21 20:11:41,254 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f90401a9c06a225e368cc626aba8722a 2023-07-21 20:11:41,255 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/67263990a032d97a21e9d2f7114be1cc/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-21 20:11:41,255 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 67263990a032d97a21e9d2f7114be1cc; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60682787, jitterRate=-0.09575600922107697}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-21 20:11:41,255 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 67263990a032d97a21e9d2f7114be1cc: 2023-07-21 20:11:41,256 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689970300857.67263990a032d97a21e9d2f7114be1cc., pid=69, masterSystemTime=1689970301232 2023-07-21 20:11:41,257 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f90401a9c06a225e368cc626aba8722a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-21 20:11:41,257 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f90401a9c06a225e368cc626aba8722a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66082847, jitterRate=-0.01528884470462799}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-21 20:11:41,257 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689970300857.67263990a032d97a21e9d2f7114be1cc. 2023-07-21 20:11:41,257 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f90401a9c06a225e368cc626aba8722a: 2023-07-21 20:11:41,258 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1689970300857.67263990a032d97a21e9d2f7114be1cc. 2023-07-21 20:11:41,260 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689970300857.f90401a9c06a225e368cc626aba8722a., pid=70, masterSystemTime=1689970301236 2023-07-21 20:11:41,260 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=67263990a032d97a21e9d2f7114be1cc, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:11:41,260 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689970300857.67263990a032d97a21e9d2f7114be1cc.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689970301260"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689970301260"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689970301260"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689970301260"}]},"ts":"1689970301260"} 2023-07-21 20:11:41,261 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689970300857.f90401a9c06a225e368cc626aba8722a. 2023-07-21 20:11:41,261 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689970300857.f90401a9c06a225e368cc626aba8722a. 2023-07-21 20:11:41,262 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=f90401a9c06a225e368cc626aba8722a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:11:41,262 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689970300857.f90401a9c06a225e368cc626aba8722a.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689970301262"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689970301262"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689970301262"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689970301262"}]},"ts":"1689970301262"} 2023-07-21 20:11:41,265 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=68 2023-07-21 20:11:41,265 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=68, state=SUCCESS; OpenRegionProcedure 67263990a032d97a21e9d2f7114be1cc, server=jenkins-hbase4.apache.org,37823,1689970216018 in 181 msec 2023-07-21 20:11:41,266 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=70, resume processing ppid=67 2023-07-21 20:11:41,266 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=70, ppid=67, state=SUCCESS; OpenRegionProcedure f90401a9c06a225e368cc626aba8722a, server=jenkins-hbase4.apache.org,34071,1689970216065 in 180 msec 2023-07-21 20:11:41,266 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=67263990a032d97a21e9d2f7114be1cc, ASSIGN in 344 msec 2023-07-21 20:11:41,268 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=67, resume processing ppid=66 2023-07-21 20:11:41,268 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f90401a9c06a225e368cc626aba8722a, ASSIGN in 345 msec 2023-07-21 20:11:41,269 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-21 20:11:41,269 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689970301269"}]},"ts":"1689970301269"} 2023-07-21 20:11:41,270 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-07-21 20:11:41,272 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-07-21 20:11:41,273 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-07-21 20:11:41,275 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37823] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-21 20:11:41,277 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 20:11:41,277 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 20:11:41,277 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 20:11:41,277 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 20:11:41,279 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-21 20:11:41,280 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-21 20:11:41,280 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-21 20:11:41,280 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-21 20:11:41,280 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-21 20:11:41,280 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-21 20:11:41,280 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-21 20:11:41,280 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-21 20:11:41,281 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 421 msec 2023-07-21 20:11:41,467 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-21 20:11:41,467 INFO [Listener at jenkins-hbase4.apache.org/38105] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-07-21 20:11:41,494 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions f90401a9c06a225e368cc626aba8722a, 67263990a032d97a21e9d2f7114be1cc 2023-07-21 20:11:41,505 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[f90401a9c06a225e368cc626aba8722a, 67263990a032d97a21e9d2f7114be1cc], force=true 2023-07-21 20:11:41,508 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[f90401a9c06a225e368cc626aba8722a, 67263990a032d97a21e9d2f7114be1cc], force=true 2023-07-21 20:11:41,508 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[f90401a9c06a225e368cc626aba8722a, 67263990a032d97a21e9d2f7114be1cc], force=true 2023-07-21 20:11:41,508 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[f90401a9c06a225e368cc626aba8722a, 67263990a032d97a21e9d2f7114be1cc], force=true 2023-07-21 20:11:41,517 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-21 20:11:41,543 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f90401a9c06a225e368cc626aba8722a, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=67263990a032d97a21e9d2f7114be1cc, UNASSIGN}] 2023-07-21 20:11:41,546 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f90401a9c06a225e368cc626aba8722a, UNASSIGN 2023-07-21 20:11:41,547 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=67263990a032d97a21e9d2f7114be1cc, UNASSIGN 2023-07-21 20:11:41,550 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=67263990a032d97a21e9d2f7114be1cc, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:11:41,550 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=f90401a9c06a225e368cc626aba8722a, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:11:41,550 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689970300857.67263990a032d97a21e9d2f7114be1cc.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689970301550"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689970301550"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689970301550"}]},"ts":"1689970301550"} 2023-07-21 20:11:41,550 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689970300857.f90401a9c06a225e368cc626aba8722a.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689970301550"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689970301550"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689970301550"}]},"ts":"1689970301550"} 2023-07-21 20:11:41,551 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=74, ppid=73, state=RUNNABLE; CloseRegionProcedure 67263990a032d97a21e9d2f7114be1cc, server=jenkins-hbase4.apache.org,37823,1689970216018}] 2023-07-21 20:11:41,552 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=75, ppid=72, state=RUNNABLE; CloseRegionProcedure f90401a9c06a225e368cc626aba8722a, server=jenkins-hbase4.apache.org,34071,1689970216065}] 2023-07-21 20:11:41,619 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-21 20:11:41,704 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 67263990a032d97a21e9d2f7114be1cc 2023-07-21 20:11:41,706 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 67263990a032d97a21e9d2f7114be1cc, disabling compactions & flushes 2023-07-21 20:11:41,706 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689970300857.67263990a032d97a21e9d2f7114be1cc. 2023-07-21 20:11:41,706 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689970300857.67263990a032d97a21e9d2f7114be1cc. 2023-07-21 20:11:41,706 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689970300857.67263990a032d97a21e9d2f7114be1cc. after waiting 0 ms 2023-07-21 20:11:41,706 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689970300857.67263990a032d97a21e9d2f7114be1cc. 2023-07-21 20:11:41,706 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 67263990a032d97a21e9d2f7114be1cc 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-21 20:11:41,707 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close f90401a9c06a225e368cc626aba8722a 2023-07-21 20:11:41,708 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f90401a9c06a225e368cc626aba8722a, disabling compactions & flushes 2023-07-21 20:11:41,708 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689970300857.f90401a9c06a225e368cc626aba8722a. 2023-07-21 20:11:41,708 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689970300857.f90401a9c06a225e368cc626aba8722a. 2023-07-21 20:11:41,708 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689970300857.f90401a9c06a225e368cc626aba8722a. after waiting 0 ms 2023-07-21 20:11:41,708 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689970300857.f90401a9c06a225e368cc626aba8722a. 2023-07-21 20:11:41,708 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing f90401a9c06a225e368cc626aba8722a 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-21 20:11:41,736 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/67263990a032d97a21e9d2f7114be1cc/.tmp/cf/59ea37802ad14167a043bb69c824beb6 2023-07-21 20:11:41,745 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/67263990a032d97a21e9d2f7114be1cc/.tmp/cf/59ea37802ad14167a043bb69c824beb6 as hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/67263990a032d97a21e9d2f7114be1cc/cf/59ea37802ad14167a043bb69c824beb6 2023-07-21 20:11:41,749 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f90401a9c06a225e368cc626aba8722a/.tmp/cf/78c8f7cb0bd64bb1975716f89b7afaa8 2023-07-21 20:11:41,752 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/67263990a032d97a21e9d2f7114be1cc/cf/59ea37802ad14167a043bb69c824beb6, entries=1, sequenceid=5, filesize=4.7 K 2023-07-21 20:11:41,753 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 67263990a032d97a21e9d2f7114be1cc in 47ms, sequenceid=5, compaction requested=false 2023-07-21 20:11:41,753 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-07-21 20:11:41,763 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f90401a9c06a225e368cc626aba8722a/.tmp/cf/78c8f7cb0bd64bb1975716f89b7afaa8 as hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f90401a9c06a225e368cc626aba8722a/cf/78c8f7cb0bd64bb1975716f89b7afaa8 2023-07-21 20:11:41,764 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/67263990a032d97a21e9d2f7114be1cc/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-21 20:11:41,764 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 20:11:41,764 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689970300857.67263990a032d97a21e9d2f7114be1cc. 2023-07-21 20:11:41,765 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 67263990a032d97a21e9d2f7114be1cc: 2023-07-21 20:11:41,767 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 67263990a032d97a21e9d2f7114be1cc 2023-07-21 20:11:41,768 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=67263990a032d97a21e9d2f7114be1cc, regionState=CLOSED 2023-07-21 20:11:41,768 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689970300857.67263990a032d97a21e9d2f7114be1cc.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689970301768"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689970301768"}]},"ts":"1689970301768"} 2023-07-21 20:11:41,770 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f90401a9c06a225e368cc626aba8722a/cf/78c8f7cb0bd64bb1975716f89b7afaa8, entries=1, sequenceid=5, filesize=4.7 K 2023-07-21 20:11:41,772 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for f90401a9c06a225e368cc626aba8722a in 64ms, sequenceid=5, compaction requested=false 2023-07-21 20:11:41,779 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=74, resume processing ppid=73 2023-07-21 20:11:41,780 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=74, ppid=73, state=SUCCESS; CloseRegionProcedure 67263990a032d97a21e9d2f7114be1cc, server=jenkins-hbase4.apache.org,37823,1689970216018 in 219 msec 2023-07-21 20:11:41,786 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=67263990a032d97a21e9d2f7114be1cc, UNASSIGN in 237 msec 2023-07-21 20:11:41,795 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f90401a9c06a225e368cc626aba8722a/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-21 20:11:41,796 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 20:11:41,796 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689970300857.f90401a9c06a225e368cc626aba8722a. 2023-07-21 20:11:41,796 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f90401a9c06a225e368cc626aba8722a: 2023-07-21 20:11:41,798 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed f90401a9c06a225e368cc626aba8722a 2023-07-21 20:11:41,799 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=f90401a9c06a225e368cc626aba8722a, regionState=CLOSED 2023-07-21 20:11:41,799 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689970300857.f90401a9c06a225e368cc626aba8722a.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689970301799"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689970301799"}]},"ts":"1689970301799"} 2023-07-21 20:11:41,808 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=75, resume processing ppid=72 2023-07-21 20:11:41,808 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=75, ppid=72, state=SUCCESS; CloseRegionProcedure f90401a9c06a225e368cc626aba8722a, server=jenkins-hbase4.apache.org,34071,1689970216065 in 249 msec 2023-07-21 20:11:41,815 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=72, resume processing ppid=71 2023-07-21 20:11:41,815 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f90401a9c06a225e368cc626aba8722a, UNASSIGN in 269 msec 2023-07-21 20:11:41,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-21 20:11:41,883 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/faef6e2dcd5b6b3fa694d1d0f51e1866/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-07-21 20:11:41,885 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689970300857.f90401a9c06a225e368cc626aba8722a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-21 20:11:41,885 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689970300857.67263990a032d97a21e9d2f7114be1cc.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-21 20:11:41,885 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689970300858.faef6e2dcd5b6b3fa694d1d0f51e1866.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-21 20:11:41,941 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=faef6e2dcd5b6b3fa694d1d0f51e1866, ASSIGN}] 2023-07-21 20:11:41,942 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=faef6e2dcd5b6b3fa694d1d0f51e1866, ASSIGN 2023-07-21 20:11:41,942 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=faef6e2dcd5b6b3fa694d1d0f51e1866, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,34071,1689970216065; forceNewPlan=false, retain=false 2023-07-21 20:11:42,098 INFO [jenkins-hbase4:41777] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-21 20:11:42,101 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=faef6e2dcd5b6b3fa694d1d0f51e1866, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:11:42,101 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689970300858.faef6e2dcd5b6b3fa694d1d0f51e1866.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689970302101"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689970302101"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689970302101"}]},"ts":"1689970302101"} 2023-07-21 20:11:42,104 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure faef6e2dcd5b6b3fa694d1d0f51e1866, server=jenkins-hbase4.apache.org,34071,1689970216065}] 2023-07-21 20:11:42,121 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-21 20:11:42,265 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689970300858.faef6e2dcd5b6b3fa694d1d0f51e1866. 2023-07-21 20:11:42,265 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => faef6e2dcd5b6b3fa694d1d0f51e1866, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689970300858.faef6e2dcd5b6b3fa694d1d0f51e1866.', STARTKEY => '', ENDKEY => ''} 2023-07-21 20:11:42,265 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689970300858.faef6e2dcd5b6b3fa694d1d0f51e1866. service=AccessControlService 2023-07-21 20:11:42,265 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 20:11:42,266 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 faef6e2dcd5b6b3fa694d1d0f51e1866 2023-07-21 20:11:42,266 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689970300858.faef6e2dcd5b6b3fa694d1d0f51e1866.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 20:11:42,266 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for faef6e2dcd5b6b3fa694d1d0f51e1866 2023-07-21 20:11:42,266 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for faef6e2dcd5b6b3fa694d1d0f51e1866 2023-07-21 20:11:42,267 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/faef6e2dcd5b6b3fa694d1d0f51e1866/.regioninfo 2023-07-21 20:11:42,295 INFO [StoreOpener-faef6e2dcd5b6b3fa694d1d0f51e1866-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region faef6e2dcd5b6b3fa694d1d0f51e1866 2023-07-21 20:11:42,296 DEBUG [StoreOpener-faef6e2dcd5b6b3fa694d1d0f51e1866-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/faef6e2dcd5b6b3fa694d1d0f51e1866/cf 2023-07-21 20:11:42,296 DEBUG [StoreOpener-faef6e2dcd5b6b3fa694d1d0f51e1866-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/faef6e2dcd5b6b3fa694d1d0f51e1866/cf 2023-07-21 20:11:42,296 INFO [StoreOpener-faef6e2dcd5b6b3fa694d1d0f51e1866-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region faef6e2dcd5b6b3fa694d1d0f51e1866 columnFamilyName cf 2023-07-21 20:11:42,339 DEBUG [StoreOpener-faef6e2dcd5b6b3fa694d1d0f51e1866-1] regionserver.HStore(539): loaded hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/faef6e2dcd5b6b3fa694d1d0f51e1866/cf/59ea37802ad14167a043bb69c824beb6.67263990a032d97a21e9d2f7114be1cc->hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/67263990a032d97a21e9d2f7114be1cc/cf/59ea37802ad14167a043bb69c824beb6-top 2023-07-21 20:11:42,345 DEBUG [StoreOpener-faef6e2dcd5b6b3fa694d1d0f51e1866-1] regionserver.HStore(539): loaded hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/faef6e2dcd5b6b3fa694d1d0f51e1866/cf/78c8f7cb0bd64bb1975716f89b7afaa8.f90401a9c06a225e368cc626aba8722a->hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f90401a9c06a225e368cc626aba8722a/cf/78c8f7cb0bd64bb1975716f89b7afaa8-top 2023-07-21 20:11:42,345 INFO [StoreOpener-faef6e2dcd5b6b3fa694d1d0f51e1866-1] regionserver.HStore(310): Store=faef6e2dcd5b6b3fa694d1d0f51e1866/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 20:11:42,346 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/faef6e2dcd5b6b3fa694d1d0f51e1866 2023-07-21 20:11:42,348 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/faef6e2dcd5b6b3fa694d1d0f51e1866 2023-07-21 20:11:42,353 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for faef6e2dcd5b6b3fa694d1d0f51e1866 2023-07-21 20:11:42,354 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened faef6e2dcd5b6b3fa694d1d0f51e1866; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63924400, jitterRate=-0.04745221138000488}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-21 20:11:42,354 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for faef6e2dcd5b6b3fa694d1d0f51e1866: 2023-07-21 20:11:42,355 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689970300858.faef6e2dcd5b6b3fa694d1d0f51e1866., pid=77, masterSystemTime=1689970302260 2023-07-21 20:11:42,356 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1689970300858.faef6e2dcd5b6b3fa694d1d0f51e1866.,because compaction is disabled. 2023-07-21 20:11:42,357 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689970300858.faef6e2dcd5b6b3fa694d1d0f51e1866. 2023-07-21 20:11:42,357 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689970300858.faef6e2dcd5b6b3fa694d1d0f51e1866. 2023-07-21 20:11:42,358 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=faef6e2dcd5b6b3fa694d1d0f51e1866, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:11:42,358 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689970300858.faef6e2dcd5b6b3fa694d1d0f51e1866.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689970302358"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689970302358"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689970302358"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689970302358"}]},"ts":"1689970302358"} 2023-07-21 20:11:42,361 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-07-21 20:11:42,362 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure faef6e2dcd5b6b3fa694d1d0f51e1866, server=jenkins-hbase4.apache.org,34071,1689970216065 in 255 msec 2023-07-21 20:11:42,363 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=71 2023-07-21 20:11:42,364 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=faef6e2dcd5b6b3fa694d1d0f51e1866, ASSIGN in 421 msec 2023-07-21 20:11:42,365 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[f90401a9c06a225e368cc626aba8722a, 67263990a032d97a21e9d2f7114be1cc], force=true in 865 msec 2023-07-21 20:11:42,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-21 20:11:42,623 INFO [Listener at jenkins-hbase4.apache.org/38105] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-07-21 20:11:42,623 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-21 20:11:42,623 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689970302623 (current time:1689970302623). 2023-07-21 20:11:42,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-21 20:11:42,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] zookeeper.ReadOnlyZKClient(139): Connect 0x43358658 to 127.0.0.1:59101 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 20:11:42,634 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5a3d4628, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 20:11:42,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 20:11:42,644 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59680, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 20:11:42,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x43358658 to 127.0.0.1:59101 2023-07-21 20:11:42,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 20:11:42,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] zookeeper.ReadOnlyZKClient(139): Connect 0x1bfbcb56 to 127.0.0.1:59101 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 20:11:42,675 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@74139937, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 20:11:42,680 DEBUG [hconnection-0x442f9d9b-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 20:11:42,688 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59686, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 20:11:42,695 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 20:11:42,701 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56950, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 20:11:42,703 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1bfbcb56 to 127.0.0.1:59101 2023-07-21 20:11:42,703 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 20:11:42,703 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-21 20:11:42,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-21 20:11:42,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-21 20:11:42,707 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-21 20:11:42,708 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-21 20:11:42,709 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1689970902709 2023-07-21 20:11:42,709 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:42,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-21 20:11:42,715 DEBUG [Listener at jenkins-hbase4.apache.org/38105] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-21 20:11:42,715 DEBUG [Listener at jenkins-hbase4.apache.org/38105] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-21 20:11:42,717 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-21 20:11:42,718 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-21 20:11:42,721 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 13 msec 2023-07-21 20:11:42,722 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-21 20:11:42,727 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1689970902727 2023-07-21 20:11:42,752 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:42,752 INFO [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-07-21 20:11:42,752 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 20:11:42,754 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-07-21 20:11:42,754 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-07-21 20:11:42,808 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:42,808 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:42,815 DEBUG [Listener at jenkins-hbase4.apache.org/38105] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 20:11:42,817 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-21 20:11:42,817 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-21 20:11:42,823 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:11:42,823 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:11:42,823 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:11:42,823 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:11:42,823 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:11:42,823 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:11:42,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:11:42,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:11:42,824 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:11:42,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:42,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:42,824 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-21 20:11:42,824 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:42,824 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:42,824 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:11:42,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:11:42,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-21 20:11:42,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:42,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-21 20:11:42,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:42,825 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-21 20:11:42,825 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-21 20:11:42,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:42,826 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:42,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-21 20:11:42,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:42,826 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-21 20:11:42,826 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:42,827 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-21 20:11:42,827 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 20:11:42,827 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:42,828 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:42,828 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-21 20:11:42,828 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-21 20:11:42,827 DEBUG [Listener at jenkins-hbase4.apache.org/38105] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-21 20:11:42,828 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 20:11:42,828 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-21 20:11:42,829 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40099,1689970215928' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-21 20:11:42,828 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-21 20:11:42,830 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-21 20:11:42,830 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-21 20:11:42,830 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 20:11:42,830 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34071,1689970216065' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-21 20:11:42,831 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-21 20:11:42,831 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-21 20:11:42,831 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37823,1689970216018' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-21 20:11:42,833 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:42,843 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:11:42,843 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:42,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:11:42,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 20:11:42,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 20:11:42,846 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:42,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 20:11:42,846 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:42,846 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 20:11:42,846 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:42,846 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 20:11:42,847 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:42,847 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 20:11:42,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 20:11:42,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:42,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:11:42,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:11:42,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:11:42,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 20:11:42,849 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34071,1689970216065' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-07-21 20:11:42,849 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@253a3cbf[Count = 0] remaining members to acquire global barrier 2023-07-21 20:11:42,849 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-07-21 20:11:42,849 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:42,862 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:42,862 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:42,862 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:42,862 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:42,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:42,862 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:42,862 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-21 20:11:42,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:42,862 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-21 20:11:42,862 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-21 20:11:42,862 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:11:42,862 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-21 20:11:42,862 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,40099,1689970215928' in zk 2023-07-21 20:11:42,863 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 20:11:42,863 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 20:11:42,863 DEBUG [rs(jenkins-hbase4.apache.org,34071,1689970216065)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689970300858.faef6e2dcd5b6b3fa694d1d0f51e1866. 2023-07-21 20:11:42,863 DEBUG [rs(jenkins-hbase4.apache.org,34071,1689970216065)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689970300858.faef6e2dcd5b6b3fa694d1d0f51e1866. started... 2023-07-21 20:11:42,865 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:42,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:42,865 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-21 20:11:42,865 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-21 20:11:42,865 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,37823,1689970216018' in zk 2023-07-21 20:11:42,865 DEBUG [rs(jenkins-hbase4.apache.org,34071,1689970216065)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for faef6e2dcd5b6b3fa694d1d0f51e1866: 2023-07-21 20:11:42,865 DEBUG [rs(jenkins-hbase4.apache.org,34071,1689970216065)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689970300858.faef6e2dcd5b6b3fa694d1d0f51e1866.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:42,865 DEBUG [rs(jenkins-hbase4.apache.org,34071,1689970216065)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 20:11:42,866 DEBUG [rs(jenkins-hbase4.apache.org,34071,1689970216065)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/faef6e2dcd5b6b3fa694d1d0f51e1866/cf/59ea37802ad14167a043bb69c824beb6.67263990a032d97a21e9d2f7114be1cc->hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/67263990a032d97a21e9d2f7114be1cc/cf/59ea37802ad14167a043bb69c824beb6-top, hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/faef6e2dcd5b6b3fa694d1d0f51e1866/cf/78c8f7cb0bd64bb1975716f89b7afaa8.f90401a9c06a225e368cc626aba8722a->hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f90401a9c06a225e368cc626aba8722a/cf/78c8f7cb0bd64bb1975716f89b7afaa8-top] hfiles 2023-07-21 20:11:42,866 DEBUG [rs(jenkins-hbase4.apache.org,34071,1689970216065)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/faef6e2dcd5b6b3fa694d1d0f51e1866/cf/59ea37802ad14167a043bb69c824beb6.67263990a032d97a21e9d2f7114be1cc for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:42,867 DEBUG [rs(jenkins-hbase4.apache.org,34071,1689970216065)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/faef6e2dcd5b6b3fa694d1d0f51e1866/cf/78c8f7cb0bd64bb1975716f89b7afaa8.f90401a9c06a225e368cc626aba8722a for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:42,870 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-21 20:11:42,870 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 20:11:42,870 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-21 20:11:42,877 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-21 20:11:42,877 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 20:11:42,877 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-21 20:11:42,898 DEBUG [rs(jenkins-hbase4.apache.org,34071,1689970216065)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689970300858.faef6e2dcd5b6b3fa694d1d0f51e1866. completed. 2023-07-21 20:11:42,898 DEBUG [rs(jenkins-hbase4.apache.org,34071,1689970216065)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689970300858.faef6e2dcd5b6b3fa694d1d0f51e1866. 2023-07-21 20:11:42,898 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 20:11:42,898 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 20:11:42,898 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:11:42,898 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-21 20:11:42,898 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,34071,1689970216065' in zk 2023-07-21 20:11:42,904 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:11:42,904 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-21 20:11:42,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:11:42,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 20:11:42,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 20:11:42,904 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 20:11:42,904 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-21 20:11:42,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 20:11:42,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 20:11:42,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:42,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:11:42,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:11:42,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:11:42,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 20:11:42,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:42,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:11:42,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:11:42,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:11:42,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,34071,1689970216065': 2023-07-21 20:11:42,915 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34071,1689970216065' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-07-21 20:11:42,915 INFO [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-07-21 20:11:42,915 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-21 20:11:42,915 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-21 20:11:42,915 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:42,915 INFO [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-21 20:11:42,919 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:42,919 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:42,919 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:42,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:42,919 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:11:42,920 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:42,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:42,920 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:42,920 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:11:42,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:42,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 20:11:42,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 20:11:42,920 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:11:42,921 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:11:42,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:11:42,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:11:42,921 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:42,921 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:11:42,921 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:42,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:42,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:42,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:42,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 20:11:42,922 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:11:42,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:11:42,922 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:11:42,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:42,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:42,930 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:11:42,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 20:11:42,931 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:11:42,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:42,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:11:42,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:11:42,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:11:42,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 20:11:42,934 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:11:42,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:42,934 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:11:42,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:11:42,935 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:11:42,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:11:42,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:11:42,939 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:11:42,939 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:11:42,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:11:42,939 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:11:42,939 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:11:42,939 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:11:42,939 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:11:42,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:11:42,940 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:11:42,939 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:42,940 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:11:42,940 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:11:42,940 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:42,940 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:11:42,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:11:42,940 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:11:42,940 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 20:11:42,940 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:11:42,940 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:42,940 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:11:42,940 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:42,940 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:11:42,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:11:42,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:11:42,940 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:11:42,941 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:42,941 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:11:42,941 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:11:42,941 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:42,941 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:42,941 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:11:42,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:11:42,941 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:42,976 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:43,029 DEBUG [Listener at jenkins-hbase4.apache.org/38105] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 20:11:43,030 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-21 20:11:43,030 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-21 20:11:43,030 DEBUG [Listener at jenkins-hbase4.apache.org/38105] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-21 20:11:43,091 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689970225203_0004_000001 (auth:SIMPLE) 2023-07-21 20:11:43,330 DEBUG [Listener at jenkins-hbase4.apache.org/38105] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 20:11:43,333 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-21 20:11:43,333 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-21 20:11:43,333 DEBUG [Listener at jenkins-hbase4.apache.org/38105] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-21 20:11:43,450 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-07-21 20:11:43,450 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:43,450 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:43,451 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1689970302709Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689970302940 (+231 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689970302940Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689970302944 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689970302961 (+17 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1689970303450 (+489 ms) 2023-07-21 20:11:43,454 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-21 20:11:43,456 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 739 msec 2023-07-21 20:11:43,834 DEBUG [Listener at jenkins-hbase4.apache.org/38105] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 20:11:43,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-21 20:11:43,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-21 20:11:43,835 INFO [Listener at jenkins-hbase4.apache.org/38105] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/export-test/export-1689970303835 2023-07-21 20:11:43,835 INFO [Listener at jenkins-hbase4.apache.org/38105] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:40641, tgtDir=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/export-test/export-1689970303835, rawTgtDir=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/export-test/export-1689970303835, srcFsUri=hdfs://localhost:40641, srcDir=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00 2023-07-21 20:11:43,872 DEBUG [Listener at jenkins-hbase4.apache.org/38105] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:40641, inputRoot=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00 2023-07-21 20:11:43,873 DEBUG [Listener at jenkins-hbase4.apache.org/38105] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1949933945_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/export-test/export-1689970303835, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/export-test/export-1689970303835/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:43,873 INFO [Listener at jenkins-hbase4.apache.org/38105] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:40641, inputRoot=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00, snapshotDir=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-07-21 20:11:43,902 INFO [Listener at jenkins-hbase4.apache.org/38105] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/export-test/export-1689970303835/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:44,031 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-21 20:11:44,032 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-21 20:11:44,032 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-21 20:11:44,033 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-21 20:11:44,368 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-21 20:11:45,263 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c4475fbf-6a12-c189-d7a2-889953ef4b74/hadoop-2845883367708260524.jar 2023-07-21 20:11:45,264 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-21 20:11:45,264 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-21 20:11:45,357 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c4475fbf-6a12-c189-d7a2-889953ef4b74/hadoop-6446418264966246755.jar 2023-07-21 20:11:45,357 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-21 20:11:45,358 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-21 20:11:45,358 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-21 20:11:45,359 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-21 20:11:45,359 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-21 20:11:45,360 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-21 20:11:45,360 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-21 20:11:45,361 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-21 20:11:45,361 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-21 20:11:45,362 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-21 20:11:45,362 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-21 20:11:45,363 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-21 20:11:45,363 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-21 20:11:45,364 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-21 20:11:45,364 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-21 20:11:45,365 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-21 20:11:45,366 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 20:11:45,366 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 20:11:45,367 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-21 20:11:45,367 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 20:11:45,367 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 20:11:45,368 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-21 20:11:45,369 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-21 20:11:46,717 WARN [Listener at jenkins-hbase4.apache.org/38105] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-21 20:11:46,720 INFO [Listener at jenkins-hbase4.apache.org/38105] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-07-21 20:11:46,722 DEBUG [Listener at jenkins-hbase4.apache.org/38105] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-07-21 20:11:46,818 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-21 20:11:46,818 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-21 20:11:47,098 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689970225203_0005_000001 (auth:SIMPLE) 2023-07-21 20:11:53,476 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689970225203_0005_000001 (auth:SIMPLE) 2023-07-21 20:11:55,888 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689970225203_0005_000001 (auth:SIMPLE) 2023-07-21 20:12:00,252 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689970225203_0005_000001 (auth:SIMPLE) 2023-07-21 20:12:02,017 INFO [Listener at jenkins-hbase4.apache.org/38105] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-21 20:12:02,025 INFO [Listener at jenkins-hbase4.apache.org/38105] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-21 20:12:02,034 INFO [Listener at jenkins-hbase4.apache.org/38105] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:12:02,035 INFO [Listener at jenkins-hbase4.apache.org/38105] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-21 20:12:02,035 INFO [Listener at jenkins-hbase4.apache.org/38105] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-21 20:12:02,036 DEBUG [Listener at jenkins-hbase4.apache.org/38105] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_895530006_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:12:02,036 DEBUG [Listener at jenkins-hbase4.apache.org/38105] snapshot.TestExportSnapshot(367): hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-21 20:12:02,036 DEBUG [Listener at jenkins-hbase4.apache.org/38105] snapshot.TestExportSnapshot(367): hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-21 20:12:02,036 DEBUG [Listener at jenkins-hbase4.apache.org/38105] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_895530006_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/export-test/export-1689970303835/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/export-test/export-1689970303835/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:12:02,037 DEBUG [Listener at jenkins-hbase4.apache.org/38105] snapshot.TestExportSnapshot(367): hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/export-test/export-1689970303835/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-21 20:12:02,037 DEBUG [Listener at jenkins-hbase4.apache.org/38105] snapshot.TestExportSnapshot(367): hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/export-test/export-1689970303835/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-21 20:12:02,044 INFO [Listener at jenkins-hbase4.apache.org/38105] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:12:02,045 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:12:02,046 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] procedure2.ProcedureExecutor(1029): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:12:02,053 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689970322053"}]},"ts":"1689970322053"} 2023-07-21 20:12:02,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-21 20:12:02,055 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-07-21 20:12:02,057 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-07-21 20:12:02,057 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=faef6e2dcd5b6b3fa694d1d0f51e1866, UNASSIGN}] 2023-07-21 20:12:02,060 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=faef6e2dcd5b6b3fa694d1d0f51e1866, UNASSIGN 2023-07-21 20:12:02,061 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=faef6e2dcd5b6b3fa694d1d0f51e1866, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:12:02,061 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689970300858.faef6e2dcd5b6b3fa694d1d0f51e1866.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689970322061"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689970322061"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689970322061"}]},"ts":"1689970322061"} 2023-07-21 20:12:02,063 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure faef6e2dcd5b6b3fa694d1d0f51e1866, server=jenkins-hbase4.apache.org,34071,1689970216065}] 2023-07-21 20:12:02,156 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-21 20:12:02,215 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close faef6e2dcd5b6b3fa694d1d0f51e1866 2023-07-21 20:12:02,215 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing faef6e2dcd5b6b3fa694d1d0f51e1866, disabling compactions & flushes 2023-07-21 20:12:02,215 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689970300858.faef6e2dcd5b6b3fa694d1d0f51e1866. 2023-07-21 20:12:02,215 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689970300858.faef6e2dcd5b6b3fa694d1d0f51e1866. 2023-07-21 20:12:02,215 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689970300858.faef6e2dcd5b6b3fa694d1d0f51e1866. after waiting 0 ms 2023-07-21 20:12:02,215 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689970300858.faef6e2dcd5b6b3fa694d1d0f51e1866. 2023-07-21 20:12:02,231 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/faef6e2dcd5b6b3fa694d1d0f51e1866/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-07-21 20:12:02,232 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 20:12:02,233 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689970300858.faef6e2dcd5b6b3fa694d1d0f51e1866. 2023-07-21 20:12:02,233 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for faef6e2dcd5b6b3fa694d1d0f51e1866: 2023-07-21 20:12:02,236 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed faef6e2dcd5b6b3fa694d1d0f51e1866 2023-07-21 20:12:02,236 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=faef6e2dcd5b6b3fa694d1d0f51e1866, regionState=CLOSED 2023-07-21 20:12:02,236 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689970300858.faef6e2dcd5b6b3fa694d1d0f51e1866.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689970322236"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689970322236"}]},"ts":"1689970322236"} 2023-07-21 20:12:02,247 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=82, resume processing ppid=81 2023-07-21 20:12:02,247 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure faef6e2dcd5b6b3fa694d1d0f51e1866, server=jenkins-hbase4.apache.org,34071,1689970216065 in 179 msec 2023-07-21 20:12:02,249 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=80 2023-07-21 20:12:02,249 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=faef6e2dcd5b6b3fa694d1d0f51e1866, UNASSIGN in 190 msec 2023-07-21 20:12:02,250 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689970322250"}]},"ts":"1689970322250"} 2023-07-21 20:12:02,257 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-07-21 20:12:02,259 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-07-21 20:12:02,264 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 217 msec 2023-07-21 20:12:02,357 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-21 20:12:02,357 INFO [Listener at jenkins-hbase4.apache.org/38105] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-07-21 20:12:02,361 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:12:02,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] procedure2.ProcedureExecutor(1029): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:12:02,377 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:12:02,377 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:12:02,378 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:12:02,380 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37823] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:12:02,383 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/faef6e2dcd5b6b3fa694d1d0f51e1866 2023-07-21 20:12:02,384 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:12:02,384 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:12:02,384 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:12:02,384 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:12:02,384 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-21 20:12:02,385 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-21 20:12:02,385 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-21 20:12:02,385 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-21 20:12:02,385 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:12:02,385 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:12:02,385 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:12:02,385 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:12:02,386 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 20:12:02,386 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 20:12:02,385 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 20:12:02,386 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 20:12:02,387 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-21 20:12:02,387 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-21 20:12:02,387 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-21 20:12:02,387 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-21 20:12:02,387 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-21 20:12:02,394 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/67263990a032d97a21e9d2f7114be1cc 2023-07-21 20:12:02,394 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f90401a9c06a225e368cc626aba8722a 2023-07-21 20:12:02,397 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/faef6e2dcd5b6b3fa694d1d0f51e1866/cf, FileablePath, hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/faef6e2dcd5b6b3fa694d1d0f51e1866/recovered.edits] 2023-07-21 20:12:02,398 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/67263990a032d97a21e9d2f7114be1cc/cf, FileablePath, hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/67263990a032d97a21e9d2f7114be1cc/recovered.edits] 2023-07-21 20:12:02,398 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f90401a9c06a225e368cc626aba8722a/cf, FileablePath, hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f90401a9c06a225e368cc626aba8722a/recovered.edits] 2023-07-21 20:12:02,403 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/faef6e2dcd5b6b3fa694d1d0f51e1866/cf/59ea37802ad14167a043bb69c824beb6.67263990a032d97a21e9d2f7114be1cc to hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/faef6e2dcd5b6b3fa694d1d0f51e1866/cf/59ea37802ad14167a043bb69c824beb6.67263990a032d97a21e9d2f7114be1cc 2023-07-21 20:12:02,404 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/67263990a032d97a21e9d2f7114be1cc/cf/59ea37802ad14167a043bb69c824beb6 to hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/67263990a032d97a21e9d2f7114be1cc/cf/59ea37802ad14167a043bb69c824beb6 2023-07-21 20:12:02,404 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f90401a9c06a225e368cc626aba8722a/cf/78c8f7cb0bd64bb1975716f89b7afaa8 to hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f90401a9c06a225e368cc626aba8722a/cf/78c8f7cb0bd64bb1975716f89b7afaa8 2023-07-21 20:12:02,405 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/faef6e2dcd5b6b3fa694d1d0f51e1866/cf/78c8f7cb0bd64bb1975716f89b7afaa8.f90401a9c06a225e368cc626aba8722a to hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/faef6e2dcd5b6b3fa694d1d0f51e1866/cf/78c8f7cb0bd64bb1975716f89b7afaa8.f90401a9c06a225e368cc626aba8722a 2023-07-21 20:12:02,411 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/67263990a032d97a21e9d2f7114be1cc/recovered.edits/8.seqid to hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/67263990a032d97a21e9d2f7114be1cc/recovered.edits/8.seqid 2023-07-21 20:12:02,411 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f90401a9c06a225e368cc626aba8722a/recovered.edits/8.seqid to hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f90401a9c06a225e368cc626aba8722a/recovered.edits/8.seqid 2023-07-21 20:12:02,412 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/faef6e2dcd5b6b3fa694d1d0f51e1866/recovered.edits/12.seqid to hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/faef6e2dcd5b6b3fa694d1d0f51e1866/recovered.edits/12.seqid 2023-07-21 20:12:02,412 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f90401a9c06a225e368cc626aba8722a 2023-07-21 20:12:02,412 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/67263990a032d97a21e9d2f7114be1cc 2023-07-21 20:12:02,413 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/faef6e2dcd5b6b3fa694d1d0f51e1866 2023-07-21 20:12:02,413 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-21 20:12:02,427 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:12:02,434 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-07-21 20:12:02,438 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-07-21 20:12:02,440 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:12:02,440 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-07-21 20:12:02,440 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689970300858.faef6e2dcd5b6b3fa694d1d0f51e1866.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689970322440"}]},"ts":"9223372036854775807"} 2023-07-21 20:12:02,442 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-07-21 20:12:02,442 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => faef6e2dcd5b6b3fa694d1d0f51e1866, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689970300858.faef6e2dcd5b6b3fa694d1d0f51e1866.', STARTKEY => '', ENDKEY => ''}] 2023-07-21 20:12:02,442 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-07-21 20:12:02,443 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689970322443"}]},"ts":"9223372036854775807"} 2023-07-21 20:12:02,449 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-07-21 20:12:02,455 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:12:02,464 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 94 msec 2023-07-21 20:12:02,488 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-21 20:12:02,488 INFO [Listener at jenkins-hbase4.apache.org/38105] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-07-21 20:12:02,489 INFO [Listener at jenkins-hbase4.apache.org/38105] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 20:12:02,490 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 20:12:02,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] procedure2.ProcedureExecutor(1029): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 20:12:02,495 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-21 20:12:02,498 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689970322498"}]},"ts":"1689970322498"} 2023-07-21 20:12:02,501 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-07-21 20:12:02,506 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-07-21 20:12:02,507 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=862fffd487c840233dd7c2f0f87615f0, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=6369aefa274a2c3b89e9054606b5b045, UNASSIGN}] 2023-07-21 20:12:02,510 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=6369aefa274a2c3b89e9054606b5b045, UNASSIGN 2023-07-21 20:12:02,510 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=862fffd487c840233dd7c2f0f87615f0, UNASSIGN 2023-07-21 20:12:02,511 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=862fffd487c840233dd7c2f0f87615f0, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:12:02,511 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=6369aefa274a2c3b89e9054606b5b045, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:12:02,511 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689970299174.862fffd487c840233dd7c2f0f87615f0.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689970322511"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689970322511"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689970322511"}]},"ts":"1689970322511"} 2023-07-21 20:12:02,511 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689970299174.6369aefa274a2c3b89e9054606b5b045.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689970322511"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689970322511"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689970322511"}]},"ts":"1689970322511"} 2023-07-21 20:12:02,513 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=87, ppid=85, state=RUNNABLE; CloseRegionProcedure 862fffd487c840233dd7c2f0f87615f0, server=jenkins-hbase4.apache.org,40099,1689970215928}] 2023-07-21 20:12:02,514 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=88, ppid=86, state=RUNNABLE; CloseRegionProcedure 6369aefa274a2c3b89e9054606b5b045, server=jenkins-hbase4.apache.org,34071,1689970216065}] 2023-07-21 20:12:02,597 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-21 20:12:02,666 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 862fffd487c840233dd7c2f0f87615f0 2023-07-21 20:12:02,666 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 862fffd487c840233dd7c2f0f87615f0, disabling compactions & flushes 2023-07-21 20:12:02,666 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689970299174.862fffd487c840233dd7c2f0f87615f0. 2023-07-21 20:12:02,666 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689970299174.862fffd487c840233dd7c2f0f87615f0. 2023-07-21 20:12:02,666 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689970299174.862fffd487c840233dd7c2f0f87615f0. after waiting 0 ms 2023-07-21 20:12:02,666 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689970299174.862fffd487c840233dd7c2f0f87615f0. 2023-07-21 20:12:02,666 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 6369aefa274a2c3b89e9054606b5b045 2023-07-21 20:12:02,667 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 6369aefa274a2c3b89e9054606b5b045, disabling compactions & flushes 2023-07-21 20:12:02,667 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689970299174.6369aefa274a2c3b89e9054606b5b045. 2023-07-21 20:12:02,667 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689970299174.6369aefa274a2c3b89e9054606b5b045. 2023-07-21 20:12:02,667 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689970299174.6369aefa274a2c3b89e9054606b5b045. after waiting 0 ms 2023-07-21 20:12:02,667 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689970299174.6369aefa274a2c3b89e9054606b5b045. 2023-07-21 20:12:02,685 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testExportFileSystemStateWithMergeRegion/6369aefa274a2c3b89e9054606b5b045/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-21 20:12:02,686 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testExportFileSystemStateWithMergeRegion/862fffd487c840233dd7c2f0f87615f0/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-21 20:12:02,686 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 20:12:02,687 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689970299174.6369aefa274a2c3b89e9054606b5b045. 2023-07-21 20:12:02,687 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 6369aefa274a2c3b89e9054606b5b045: 2023-07-21 20:12:02,688 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 20:12:02,689 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689970299174.862fffd487c840233dd7c2f0f87615f0. 2023-07-21 20:12:02,689 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 862fffd487c840233dd7c2f0f87615f0: 2023-07-21 20:12:02,695 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 6369aefa274a2c3b89e9054606b5b045 2023-07-21 20:12:02,696 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=6369aefa274a2c3b89e9054606b5b045, regionState=CLOSED 2023-07-21 20:12:02,696 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689970299174.6369aefa274a2c3b89e9054606b5b045.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689970322696"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689970322696"}]},"ts":"1689970322696"} 2023-07-21 20:12:02,696 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 862fffd487c840233dd7c2f0f87615f0 2023-07-21 20:12:02,697 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=862fffd487c840233dd7c2f0f87615f0, regionState=CLOSED 2023-07-21 20:12:02,698 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689970299174.862fffd487c840233dd7c2f0f87615f0.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689970322697"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689970322697"}]},"ts":"1689970322697"} 2023-07-21 20:12:02,701 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=88, resume processing ppid=86 2023-07-21 20:12:02,701 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=88, ppid=86, state=SUCCESS; CloseRegionProcedure 6369aefa274a2c3b89e9054606b5b045, server=jenkins-hbase4.apache.org,34071,1689970216065 in 184 msec 2023-07-21 20:12:02,704 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=6369aefa274a2c3b89e9054606b5b045, UNASSIGN in 194 msec 2023-07-21 20:12:02,708 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=87, resume processing ppid=85 2023-07-21 20:12:02,708 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=87, ppid=85, state=SUCCESS; CloseRegionProcedure 862fffd487c840233dd7c2f0f87615f0, server=jenkins-hbase4.apache.org,40099,1689970215928 in 190 msec 2023-07-21 20:12:02,711 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=85, resume processing ppid=84 2023-07-21 20:12:02,712 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=862fffd487c840233dd7c2f0f87615f0, UNASSIGN in 201 msec 2023-07-21 20:12:02,715 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689970322714"}]},"ts":"1689970322714"} 2023-07-21 20:12:02,718 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-07-21 20:12:02,720 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-07-21 20:12:02,723 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 231 msec 2023-07-21 20:12:02,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-21 20:12:02,799 INFO [Listener at jenkins-hbase4.apache.org/38105] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-07-21 20:12:02,800 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 20:12:02,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] procedure2.ProcedureExecutor(1029): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 20:12:02,807 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 20:12:02,807 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 20:12:02,809 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 20:12:02,811 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37823] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 20:12:02,814 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 20:12:02,814 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 20:12:02,814 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 20:12:02,814 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 20:12:02,814 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-21 20:12:02,814 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-21 20:12:02,814 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-21 20:12:02,815 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-21 20:12:02,817 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 20:12:02,817 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 20:12:02,817 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 20:12:02,817 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 20:12:02,818 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 20:12:02,818 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 20:12:02,818 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 20:12:02,818 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 20:12:02,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-21 20:12:02,819 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/862fffd487c840233dd7c2f0f87615f0 2023-07-21 20:12:02,820 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/6369aefa274a2c3b89e9054606b5b045 2023-07-21 20:12:02,822 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/862fffd487c840233dd7c2f0f87615f0/cf, FileablePath, hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/862fffd487c840233dd7c2f0f87615f0/recovered.edits] 2023-07-21 20:12:02,822 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/6369aefa274a2c3b89e9054606b5b045/cf, FileablePath, hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/6369aefa274a2c3b89e9054606b5b045/recovered.edits] 2023-07-21 20:12:02,834 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/862fffd487c840233dd7c2f0f87615f0/cf/2a580da1a1ea4d9483596483bc1a1b56 to hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/862fffd487c840233dd7c2f0f87615f0/cf/2a580da1a1ea4d9483596483bc1a1b56 2023-07-21 20:12:02,835 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/6369aefa274a2c3b89e9054606b5b045/cf/689f7b51033f40daad00e0bf3eee0ec1 to hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/6369aefa274a2c3b89e9054606b5b045/cf/689f7b51033f40daad00e0bf3eee0ec1 2023-07-21 20:12:02,848 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/862fffd487c840233dd7c2f0f87615f0/recovered.edits/9.seqid to hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/862fffd487c840233dd7c2f0f87615f0/recovered.edits/9.seqid 2023-07-21 20:12:02,848 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/6369aefa274a2c3b89e9054606b5b045/recovered.edits/9.seqid to hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/6369aefa274a2c3b89e9054606b5b045/recovered.edits/9.seqid 2023-07-21 20:12:02,849 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/862fffd487c840233dd7c2f0f87615f0 2023-07-21 20:12:02,849 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/6369aefa274a2c3b89e9054606b5b045 2023-07-21 20:12:02,849 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-21 20:12:02,850 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-07-21 20:12:02,852 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf] 2023-07-21 20:12:02,861 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202307215a832739023f4623a63b9fb16a8dceea to hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202307215a832739023f4623a63b9fb16a8dceea 2023-07-21 20:12:02,863 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230721aeff53aabe654049b9ad4fdc39c36330 to hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230721aeff53aabe654049b9ad4fdc39c36330 2023-07-21 20:12:02,863 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-07-21 20:12:02,866 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 20:12:02,868 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-07-21 20:12:02,872 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-07-21 20:12:02,873 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 20:12:02,873 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-07-21 20:12:02,873 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689970299174.862fffd487c840233dd7c2f0f87615f0.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689970322873"}]},"ts":"9223372036854775807"} 2023-07-21 20:12:02,873 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689970299174.6369aefa274a2c3b89e9054606b5b045.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689970322873"}]},"ts":"9223372036854775807"} 2023-07-21 20:12:02,875 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-21 20:12:02,875 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 862fffd487c840233dd7c2f0f87615f0, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689970299174.862fffd487c840233dd7c2f0f87615f0.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 6369aefa274a2c3b89e9054606b5b045, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689970299174.6369aefa274a2c3b89e9054606b5b045.', STARTKEY => '1', ENDKEY => ''}] 2023-07-21 20:12:02,875 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-07-21 20:12:02,875 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689970322875"}]},"ts":"9223372036854775807"} 2023-07-21 20:12:02,876 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-07-21 20:12:02,878 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 20:12:02,879 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 78 msec 2023-07-21 20:12:02,920 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-21 20:12:02,921 INFO [Listener at jenkins-hbase4.apache.org/38105] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-07-21 20:12:02,941 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-21 20:12:02,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:12:02,946 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-21 20:12:02,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:12:02,962 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-07-21 20:12:02,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:12:03,005 INFO [Listener at jenkins-hbase4.apache.org/38105] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=758 (was 746) Potentially hanging thread: Thread-4100 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x3e3f9760-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_895530006_17 at /127.0.0.1:37724 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_920246557_1 at /127.0.0.1:47618 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3e3f9760-shared-pool-29 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1354340851) connection to jenkins-hbase4.apache.org/172.31.14.131:45997 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x3e3f9760-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3e3f9760-shared-pool-27 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_895530006_17 at /127.0.0.1:56054 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_895530006_17 at /127.0.0.1:37668 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3e3f9760-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3e3f9760-shared-pool-28 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_920246557_1 at /127.0.0.1:53016 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=915 (was 901) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=413 (was 376) - SystemLoadAverage LEAK? -, ProcessCount=184 (was 187), AvailableMemoryMB=6702 (was 6795) 2023-07-21 20:12:03,006 WARN [Listener at jenkins-hbase4.apache.org/38105] hbase.ResourceChecker(130): Thread=758 is superior to 500 2023-07-21 20:12:03,072 INFO [Listener at jenkins-hbase4.apache.org/38105] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=758, OpenFileDescriptor=915, MaxFileDescriptor=60000, SystemLoadAverage=413, ProcessCount=184, AvailableMemoryMB=6677 2023-07-21 20:12:03,072 WARN [Listener at jenkins-hbase4.apache.org/38105] hbase.ResourceChecker(130): Thread=758 is superior to 500 2023-07-21 20:12:03,075 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-21 20:12:03,077 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] procedure2.ProcedureExecutor(1029): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-21 20:12:03,081 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-21 20:12:03,082 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-07-21 20:12:03,083 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-21 20:12:03,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-21 20:12:03,087 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testEmptyExportFileSystemState/96d9ce9c7a0da6d2b8c60f848e67a6e2 2023-07-21 20:12:03,087 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testEmptyExportFileSystemState/c4cd11f8915cf34b3b291311fb8d8f70 2023-07-21 20:12:03,089 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testEmptyExportFileSystemState/96d9ce9c7a0da6d2b8c60f848e67a6e2 empty. 2023-07-21 20:12:03,089 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testEmptyExportFileSystemState/c4cd11f8915cf34b3b291311fb8d8f70 empty. 2023-07-21 20:12:03,089 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testEmptyExportFileSystemState/c4cd11f8915cf34b3b291311fb8d8f70 2023-07-21 20:12:03,090 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testEmptyExportFileSystemState/96d9ce9c7a0da6d2b8c60f848e67a6e2 2023-07-21 20:12:03,090 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-21 20:12:03,185 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-21 20:12:03,387 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-21 20:12:03,511 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-21 20:12:03,513 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 96d9ce9c7a0da6d2b8c60f848e67a6e2, NAME => 'testtb-testEmptyExportFileSystemState,,1689970323075.96d9ce9c7a0da6d2b8c60f848e67a6e2.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp 2023-07-21 20:12:03,515 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => c4cd11f8915cf34b3b291311fb8d8f70, NAME => 'testtb-testEmptyExportFileSystemState,1,1689970323075.c4cd11f8915cf34b3b291311fb8d8f70.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp 2023-07-21 20:12:03,530 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689970323075.96d9ce9c7a0da6d2b8c60f848e67a6e2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 20:12:03,531 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 96d9ce9c7a0da6d2b8c60f848e67a6e2, disabling compactions & flushes 2023-07-21 20:12:03,531 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689970323075.96d9ce9c7a0da6d2b8c60f848e67a6e2. 2023-07-21 20:12:03,531 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689970323075.96d9ce9c7a0da6d2b8c60f848e67a6e2. 2023-07-21 20:12:03,531 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689970323075.96d9ce9c7a0da6d2b8c60f848e67a6e2. after waiting 0 ms 2023-07-21 20:12:03,531 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689970323075.96d9ce9c7a0da6d2b8c60f848e67a6e2. 2023-07-21 20:12:03,531 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689970323075.96d9ce9c7a0da6d2b8c60f848e67a6e2. 2023-07-21 20:12:03,531 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 96d9ce9c7a0da6d2b8c60f848e67a6e2: 2023-07-21 20:12:03,536 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689970323075.c4cd11f8915cf34b3b291311fb8d8f70.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 20:12:03,536 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing c4cd11f8915cf34b3b291311fb8d8f70, disabling compactions & flushes 2023-07-21 20:12:03,536 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689970323075.c4cd11f8915cf34b3b291311fb8d8f70. 2023-07-21 20:12:03,537 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689970323075.c4cd11f8915cf34b3b291311fb8d8f70. 2023-07-21 20:12:03,537 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689970323075.c4cd11f8915cf34b3b291311fb8d8f70. after waiting 0 ms 2023-07-21 20:12:03,537 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689970323075.c4cd11f8915cf34b3b291311fb8d8f70. 2023-07-21 20:12:03,537 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689970323075.c4cd11f8915cf34b3b291311fb8d8f70. 2023-07-21 20:12:03,537 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for c4cd11f8915cf34b3b291311fb8d8f70: 2023-07-21 20:12:03,539 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-21 20:12:03,541 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689970323075.96d9ce9c7a0da6d2b8c60f848e67a6e2.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689970323540"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689970323540"}]},"ts":"1689970323540"} 2023-07-21 20:12:03,541 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689970323075.c4cd11f8915cf34b3b291311fb8d8f70.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689970323540"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689970323540"}]},"ts":"1689970323540"} 2023-07-21 20:12:03,543 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-21 20:12:03,543 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-21 20:12:03,544 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689970323543"}]},"ts":"1689970323543"} 2023-07-21 20:12:03,545 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-07-21 20:12:03,549 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-21 20:12:03,550 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-21 20:12:03,550 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-21 20:12:03,550 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-21 20:12:03,550 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-21 20:12:03,551 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=96d9ce9c7a0da6d2b8c60f848e67a6e2, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=c4cd11f8915cf34b3b291311fb8d8f70, ASSIGN}] 2023-07-21 20:12:03,554 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=c4cd11f8915cf34b3b291311fb8d8f70, ASSIGN 2023-07-21 20:12:03,554 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=96d9ce9c7a0da6d2b8c60f848e67a6e2, ASSIGN 2023-07-21 20:12:03,554 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=96d9ce9c7a0da6d2b8c60f848e67a6e2, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37823,1689970216018; forceNewPlan=false, retain=false 2023-07-21 20:12:03,554 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=c4cd11f8915cf34b3b291311fb8d8f70, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40099,1689970215928; forceNewPlan=false, retain=false 2023-07-21 20:12:03,688 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-21 20:12:03,704 INFO [jenkins-hbase4:41777] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-21 20:12:03,712 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=96d9ce9c7a0da6d2b8c60f848e67a6e2, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:12:03,712 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=c4cd11f8915cf34b3b291311fb8d8f70, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:12:03,712 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689970323075.96d9ce9c7a0da6d2b8c60f848e67a6e2.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689970323712"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689970323712"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689970323712"}]},"ts":"1689970323712"} 2023-07-21 20:12:03,712 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689970323075.c4cd11f8915cf34b3b291311fb8d8f70.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689970323712"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689970323712"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689970323712"}]},"ts":"1689970323712"} 2023-07-21 20:12:03,714 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=91, state=RUNNABLE; OpenRegionProcedure 96d9ce9c7a0da6d2b8c60f848e67a6e2, server=jenkins-hbase4.apache.org,37823,1689970216018}] 2023-07-21 20:12:03,716 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=92, state=RUNNABLE; OpenRegionProcedure c4cd11f8915cf34b3b291311fb8d8f70, server=jenkins-hbase4.apache.org,40099,1689970215928}] 2023-07-21 20:12:03,874 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1689970323075.c4cd11f8915cf34b3b291311fb8d8f70. 2023-07-21 20:12:03,874 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c4cd11f8915cf34b3b291311fb8d8f70, NAME => 'testtb-testEmptyExportFileSystemState,1,1689970323075.c4cd11f8915cf34b3b291311fb8d8f70.', STARTKEY => '1', ENDKEY => ''} 2023-07-21 20:12:03,875 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1689970323075.c4cd11f8915cf34b3b291311fb8d8f70. service=AccessControlService 2023-07-21 20:12:03,875 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 20:12:03,875 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1689970323075.96d9ce9c7a0da6d2b8c60f848e67a6e2. 2023-07-21 20:12:03,875 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState c4cd11f8915cf34b3b291311fb8d8f70 2023-07-21 20:12:03,875 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 96d9ce9c7a0da6d2b8c60f848e67a6e2, NAME => 'testtb-testEmptyExportFileSystemState,,1689970323075.96d9ce9c7a0da6d2b8c60f848e67a6e2.', STARTKEY => '', ENDKEY => '1'} 2023-07-21 20:12:03,875 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689970323075.c4cd11f8915cf34b3b291311fb8d8f70.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 20:12:03,875 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c4cd11f8915cf34b3b291311fb8d8f70 2023-07-21 20:12:03,875 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c4cd11f8915cf34b3b291311fb8d8f70 2023-07-21 20:12:03,875 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1689970323075.96d9ce9c7a0da6d2b8c60f848e67a6e2. service=AccessControlService 2023-07-21 20:12:03,876 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 20:12:03,876 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 96d9ce9c7a0da6d2b8c60f848e67a6e2 2023-07-21 20:12:03,876 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689970323075.96d9ce9c7a0da6d2b8c60f848e67a6e2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 20:12:03,876 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 96d9ce9c7a0da6d2b8c60f848e67a6e2 2023-07-21 20:12:03,876 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 96d9ce9c7a0da6d2b8c60f848e67a6e2 2023-07-21 20:12:03,878 INFO [StoreOpener-c4cd11f8915cf34b3b291311fb8d8f70-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region c4cd11f8915cf34b3b291311fb8d8f70 2023-07-21 20:12:03,879 INFO [StoreOpener-96d9ce9c7a0da6d2b8c60f848e67a6e2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 96d9ce9c7a0da6d2b8c60f848e67a6e2 2023-07-21 20:12:03,879 DEBUG [StoreOpener-c4cd11f8915cf34b3b291311fb8d8f70-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testEmptyExportFileSystemState/c4cd11f8915cf34b3b291311fb8d8f70/cf 2023-07-21 20:12:03,880 DEBUG [StoreOpener-c4cd11f8915cf34b3b291311fb8d8f70-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testEmptyExportFileSystemState/c4cd11f8915cf34b3b291311fb8d8f70/cf 2023-07-21 20:12:03,880 INFO [StoreOpener-c4cd11f8915cf34b3b291311fb8d8f70-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c4cd11f8915cf34b3b291311fb8d8f70 columnFamilyName cf 2023-07-21 20:12:03,885 DEBUG [StoreOpener-96d9ce9c7a0da6d2b8c60f848e67a6e2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testEmptyExportFileSystemState/96d9ce9c7a0da6d2b8c60f848e67a6e2/cf 2023-07-21 20:12:03,885 DEBUG [StoreOpener-96d9ce9c7a0da6d2b8c60f848e67a6e2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testEmptyExportFileSystemState/96d9ce9c7a0da6d2b8c60f848e67a6e2/cf 2023-07-21 20:12:03,885 INFO [StoreOpener-c4cd11f8915cf34b3b291311fb8d8f70-1] regionserver.HStore(310): Store=c4cd11f8915cf34b3b291311fb8d8f70/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 20:12:03,886 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testEmptyExportFileSystemState/c4cd11f8915cf34b3b291311fb8d8f70 2023-07-21 20:12:03,887 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testEmptyExportFileSystemState/c4cd11f8915cf34b3b291311fb8d8f70 2023-07-21 20:12:03,885 INFO [StoreOpener-96d9ce9c7a0da6d2b8c60f848e67a6e2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 96d9ce9c7a0da6d2b8c60f848e67a6e2 columnFamilyName cf 2023-07-21 20:12:03,888 INFO [StoreOpener-96d9ce9c7a0da6d2b8c60f848e67a6e2-1] regionserver.HStore(310): Store=96d9ce9c7a0da6d2b8c60f848e67a6e2/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 20:12:03,892 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c4cd11f8915cf34b3b291311fb8d8f70 2023-07-21 20:12:03,894 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testEmptyExportFileSystemState/96d9ce9c7a0da6d2b8c60f848e67a6e2 2023-07-21 20:12:03,895 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testEmptyExportFileSystemState/96d9ce9c7a0da6d2b8c60f848e67a6e2 2023-07-21 20:12:03,896 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testEmptyExportFileSystemState/c4cd11f8915cf34b3b291311fb8d8f70/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-21 20:12:03,897 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c4cd11f8915cf34b3b291311fb8d8f70; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74569307, jitterRate=0.11116926372051239}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-21 20:12:03,897 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c4cd11f8915cf34b3b291311fb8d8f70: 2023-07-21 20:12:03,898 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1689970323075.c4cd11f8915cf34b3b291311fb8d8f70., pid=94, masterSystemTime=1689970323867 2023-07-21 20:12:03,899 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 96d9ce9c7a0da6d2b8c60f848e67a6e2 2023-07-21 20:12:03,900 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1689970323075.c4cd11f8915cf34b3b291311fb8d8f70. 2023-07-21 20:12:03,900 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1689970323075.c4cd11f8915cf34b3b291311fb8d8f70. 2023-07-21 20:12:03,902 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=c4cd11f8915cf34b3b291311fb8d8f70, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:12:03,902 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testEmptyExportFileSystemState/96d9ce9c7a0da6d2b8c60f848e67a6e2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-21 20:12:03,902 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1689970323075.c4cd11f8915cf34b3b291311fb8d8f70.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689970323901"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689970323901"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689970323901"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689970323901"}]},"ts":"1689970323901"} 2023-07-21 20:12:03,902 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 96d9ce9c7a0da6d2b8c60f848e67a6e2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65782390, jitterRate=-0.019766002893447876}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-21 20:12:03,902 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 96d9ce9c7a0da6d2b8c60f848e67a6e2: 2023-07-21 20:12:03,903 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1689970323075.96d9ce9c7a0da6d2b8c60f848e67a6e2., pid=93, masterSystemTime=1689970323866 2023-07-21 20:12:03,909 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1689970323075.96d9ce9c7a0da6d2b8c60f848e67a6e2. 2023-07-21 20:12:03,909 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1689970323075.96d9ce9c7a0da6d2b8c60f848e67a6e2. 2023-07-21 20:12:03,909 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=96d9ce9c7a0da6d2b8c60f848e67a6e2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:12:03,910 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1689970323075.96d9ce9c7a0da6d2b8c60f848e67a6e2.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689970323909"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689970323909"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689970323909"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689970323909"}]},"ts":"1689970323909"} 2023-07-21 20:12:03,911 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=92 2023-07-21 20:12:03,911 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=92, state=SUCCESS; OpenRegionProcedure c4cd11f8915cf34b3b291311fb8d8f70, server=jenkins-hbase4.apache.org,40099,1689970215928 in 188 msec 2023-07-21 20:12:03,914 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=c4cd11f8915cf34b3b291311fb8d8f70, ASSIGN in 360 msec 2023-07-21 20:12:03,916 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=91 2023-07-21 20:12:03,917 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=91, state=SUCCESS; OpenRegionProcedure 96d9ce9c7a0da6d2b8c60f848e67a6e2, server=jenkins-hbase4.apache.org,37823,1689970216018 in 198 msec 2023-07-21 20:12:03,920 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=91, resume processing ppid=90 2023-07-21 20:12:03,920 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=96d9ce9c7a0da6d2b8c60f848e67a6e2, ASSIGN in 366 msec 2023-07-21 20:12:03,922 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-21 20:12:03,922 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689970323922"}]},"ts":"1689970323922"} 2023-07-21 20:12:03,923 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-07-21 20:12:03,933 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-21 20:12:03,933 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-07-21 20:12:03,935 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37823] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-21 20:12:03,937 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 20:12:03,937 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 20:12:03,937 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 20:12:03,937 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 20:12:03,938 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-21 20:12:03,938 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-21 20:12:03,939 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-21 20:12:03,940 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-21 20:12:03,940 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 864 msec 2023-07-21 20:12:04,190 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-21 20:12:04,190 INFO [Listener at jenkins-hbase4.apache.org/38105] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-07-21 20:12:04,193 DEBUG [Listener at jenkins-hbase4.apache.org/38105] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-21 20:12:04,193 DEBUG [Listener at jenkins-hbase4.apache.org/38105] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1689970323075.96d9ce9c7a0da6d2b8c60f848e67a6e2. 2023-07-21 20:12:04,195 INFO [Listener at jenkins-hbase4.apache.org/38105] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-21 20:12:04,212 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-21 20:12:04,213 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689970324213 (current time:1689970324213). 2023-07-21 20:12:04,213 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-21 20:12:04,213 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] zookeeper.ReadOnlyZKClient(139): Connect 0x6fd2ea1d to 127.0.0.1:59101 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 20:12:04,223 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@22b72cc4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 20:12:04,228 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 20:12:04,230 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44604, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 20:12:04,231 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6fd2ea1d to 127.0.0.1:59101 2023-07-21 20:12:04,231 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 20:12:04,232 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] zookeeper.ReadOnlyZKClient(139): Connect 0x3a0549d8 to 127.0.0.1:59101 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 20:12:04,241 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@427fce87, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 20:12:04,243 DEBUG [hconnection-0x59b50b00-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 20:12:04,246 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44608, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 20:12:04,251 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 20:12:04,254 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49544, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 20:12:04,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3a0549d8 to 127.0.0.1:59101 2023-07-21 20:12:04,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 20:12:04,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-21 20:12:04,257 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-21 20:12:04,257 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-21 20:12:04,260 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-21 20:12:04,261 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-21 20:12:04,262 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689970924262 2023-07-21 20:12:04,262 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-21 20:12:04,262 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-21 20:12:04,264 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-21 20:12:04,265 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-21 20:12:04,265 DEBUG [Listener at jenkins-hbase4.apache.org/38105] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-21 20:12:04,265 DEBUG [Listener at jenkins-hbase4.apache.org/38105] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-21 20:12:04,266 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-07-21 20:12:04,271 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-21 20:12:04,272 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689970924272 2023-07-21 20:12:04,297 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:04,297 INFO [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-07-21 20:12:04,297 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 20:12:04,299 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-21 20:12:04,299 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-21 20:12:04,303 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:04,303 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:04,311 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:12:04,311 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:12:04,311 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:12:04,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:12:04,311 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:12:04,311 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:12:04,311 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:12:04,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:12:04,311 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:12:04,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:12:04,311 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:12:04,312 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:12:04,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:04,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:04,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:04,314 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:04,314 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:04,314 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:04,314 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:12:04,314 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-21 20:12:04,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-21 20:12:04,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-21 20:12:04,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:04,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:04,315 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-21 20:12:04,315 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-21 20:12:04,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-21 20:12:04,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:04,315 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-21 20:12:04,315 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:04,315 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-21 20:12:04,315 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:04,315 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 20:12:04,316 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-21 20:12:04,318 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-21 20:12:04,316 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:04,318 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-21 20:12:04,318 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34071,1689970216065' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-21 20:12:04,318 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 20:12:04,318 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-21 20:12:04,319 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 20:12:04,322 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-21 20:12:04,322 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-21 20:12:04,322 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37823,1689970216018' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-21 20:12:04,322 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-21 20:12:04,322 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-21 20:12:04,322 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40099,1689970215928' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-21 20:12:04,331 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:04,333 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:12:04,333 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:04,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:12:04,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 20:12:04,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 20:12:04,333 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:12:04,334 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:04,334 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 20:12:04,334 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:04,334 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 20:12:04,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 20:12:04,337 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:04,337 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:04,337 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 20:12:04,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 20:12:04,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:04,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:12:04,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:12:04,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:12:04,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 20:12:04,343 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37823,1689970216018' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-21 20:12:04,343 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1ad4af2[Count = 1] remaining members to acquire global barrier 2023-07-21 20:12:04,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:12:04,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 20:12:04,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 20:12:04,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 20:12:04,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 20:12:04,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:04,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:12:04,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:12:04,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:12:04,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 20:12:04,345 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40099,1689970215928' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-21 20:12:04,345 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1ad4af2[Count = 0] remaining members to acquire global barrier 2023-07-21 20:12:04,345 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-21 20:12:04,346 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:04,348 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:04,348 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:04,348 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:04,348 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:04,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:04,348 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:04,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:04,348 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-21 20:12:04,349 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:04,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:04,349 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-21 20:12:04,349 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-21 20:12:04,349 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,34071,1689970216065' in zk 2023-07-21 20:12:04,349 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:12:04,349 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-21 20:12:04,349 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 20:12:04,350 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 20:12:04,350 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 20:12:04,350 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 20:12:04,350 DEBUG [rs(jenkins-hbase4.apache.org,40099,1689970215928)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689970323075.c4cd11f8915cf34b3b291311fb8d8f70. 2023-07-21 20:12:04,350 DEBUG [rs(jenkins-hbase4.apache.org,37823,1689970216018)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689970323075.96d9ce9c7a0da6d2b8c60f848e67a6e2. 2023-07-21 20:12:04,350 DEBUG [rs(jenkins-hbase4.apache.org,40099,1689970215928)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689970323075.c4cd11f8915cf34b3b291311fb8d8f70. started... 2023-07-21 20:12:04,350 DEBUG [rs(jenkins-hbase4.apache.org,37823,1689970216018)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689970323075.96d9ce9c7a0da6d2b8c60f848e67a6e2. started... 2023-07-21 20:12:04,352 DEBUG [rs(jenkins-hbase4.apache.org,40099,1689970215928)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c4cd11f8915cf34b3b291311fb8d8f70: 2023-07-21 20:12:04,352 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-21 20:12:04,352 DEBUG [rs(jenkins-hbase4.apache.org,37823,1689970216018)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 96d9ce9c7a0da6d2b8c60f848e67a6e2: 2023-07-21 20:12:04,352 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:12:04,352 DEBUG [rs(jenkins-hbase4.apache.org,40099,1689970215928)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689970323075.c4cd11f8915cf34b3b291311fb8d8f70.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:04,352 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 20:12:04,352 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-21 20:12:04,352 DEBUG [rs(jenkins-hbase4.apache.org,37823,1689970216018)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689970323075.96d9ce9c7a0da6d2b8c60f848e67a6e2.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:04,352 DEBUG [rs(jenkins-hbase4.apache.org,40099,1689970215928)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 20:12:04,354 DEBUG [rs(jenkins-hbase4.apache.org,37823,1689970216018)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 20:12:04,352 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-21 20:12:04,354 DEBUG [rs(jenkins-hbase4.apache.org,37823,1689970216018)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-21 20:12:04,354 DEBUG [rs(jenkins-hbase4.apache.org,40099,1689970215928)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-21 20:12:04,366 DEBUG [Listener at jenkins-hbase4.apache.org/38105] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 20:12:04,367 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-21 20:12:04,367 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-21 20:12:04,367 DEBUG [Listener at jenkins-hbase4.apache.org/38105] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-21 20:12:04,375 DEBUG [rs(jenkins-hbase4.apache.org,40099,1689970215928)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689970323075.c4cd11f8915cf34b3b291311fb8d8f70. completed. 2023-07-21 20:12:04,375 DEBUG [rs(jenkins-hbase4.apache.org,40099,1689970215928)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689970323075.c4cd11f8915cf34b3b291311fb8d8f70. 2023-07-21 20:12:04,375 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 20:12:04,375 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 20:12:04,375 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:12:04,375 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-21 20:12:04,375 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40099,1689970215928' in zk 2023-07-21 20:12:04,378 DEBUG [rs(jenkins-hbase4.apache.org,37823,1689970216018)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689970323075.96d9ce9c7a0da6d2b8c60f848e67a6e2. completed. 2023-07-21 20:12:04,378 DEBUG [rs(jenkins-hbase4.apache.org,37823,1689970216018)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689970323075.96d9ce9c7a0da6d2b8c60f848e67a6e2. 2023-07-21 20:12:04,378 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:12:04,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:12:04,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 20:12:04,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 20:12:04,379 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-21 20:12:04,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 20:12:04,379 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 20:12:04,379 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-21 20:12:04,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 20:12:04,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:04,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:12:04,382 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 20:12:04,382 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 20:12:04,382 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:12:04,383 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-21 20:12:04,383 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,37823,1689970216018' in zk 2023-07-21 20:12:04,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:12:04,387 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:12:04,387 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-21 20:12:04,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:12:04,387 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 20:12:04,387 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-21 20:12:04,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 20:12:04,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:04,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:12:04,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:12:04,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:12:04,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,40099,1689970215928': 2023-07-21 20:12:04,402 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40099,1689970215928' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-21 20:12:04,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:12:04,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 20:12:04,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 20:12:04,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 20:12:04,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 20:12:04,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:04,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:12:04,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:12:04,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:12:04,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 20:12:04,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:04,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:12:04,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:12:04,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:12:04,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,37823,1689970216018': 2023-07-21 20:12:04,410 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37823,1689970216018' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-21 20:12:04,410 INFO [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-07-21 20:12:04,410 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-21 20:12:04,410 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-21 20:12:04,410 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:04,410 INFO [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-21 20:12:04,413 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:04,413 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:04,413 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:04,413 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:04,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:04,413 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:04,413 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:12:04,414 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:04,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:04,413 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:12:04,414 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:12:04,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:04,414 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:12:04,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:12:04,414 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:12:04,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:12:04,414 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:12:04,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:12:04,415 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:04,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:04,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:04,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:04,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:04,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 20:12:04,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 20:12:04,415 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:12:04,420 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:12:04,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 20:12:04,421 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:12:04,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:04,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 20:12:04,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:04,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:12:04,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:12:04,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:12:04,424 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:12:04,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 20:12:04,424 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:12:04,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:04,424 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:12:04,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:12:04,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:12:04,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:12:04,429 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:12:04,429 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:12:04,429 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:12:04,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:12:04,429 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:12:04,429 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:12:04,429 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:12:04,429 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:12:04,429 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:04,429 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 20:12:04,429 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:12:04,429 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:04,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:12:04,430 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:12:04,432 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:04,432 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:12:04,432 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-07-21 20:12:04,432 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:04,432 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-21 20:12:04,431 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:12:04,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:12:04,432 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:12:04,432 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:04,432 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:12:04,432 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:12:04,433 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:04,433 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:04,432 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:12:04,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:12:04,432 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:12:04,433 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-21 20:12:04,433 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:12:04,433 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:12:04,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:12:04,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:12:04,500 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:04,501 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:04,568 DEBUG [Listener at jenkins-hbase4.apache.org/38105] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 20:12:04,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-21 20:12:04,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-21 20:12:04,569 DEBUG [Listener at jenkins-hbase4.apache.org/38105] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-21 20:12:04,679 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:04,765 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-21 20:12:04,765 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:04,765 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:04,766 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689970324262Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1689970324500 (+238 ms)Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689970324500Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1689970324500Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1689970324522 (+22 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689970324652 (+130 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689970324765 (+113 ms) 2023-07-21 20:12:04,773 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-21 20:12:04,776 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 509 msec 2023-07-21 20:12:04,869 DEBUG [Listener at jenkins-hbase4.apache.org/38105] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 20:12:04,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-21 20:12:04,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-21 20:12:04,874 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37823] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1689970323075.96d9ce9c7a0da6d2b8c60f848e67a6e2. with WAL disabled. Data may be lost in the event of a crash. 2023-07-21 20:12:04,876 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1689970323075.c4cd11f8915cf34b3b291311fb8d8f70. with WAL disabled. Data may be lost in the event of a crash. 2023-07-21 20:12:04,881 DEBUG [Listener at jenkins-hbase4.apache.org/38105] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-21 20:12:04,882 DEBUG [Listener at jenkins-hbase4.apache.org/38105] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1689970323075.96d9ce9c7a0da6d2b8c60f848e67a6e2. 2023-07-21 20:12:04,882 INFO [Listener at jenkins-hbase4.apache.org/38105] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-21 20:12:04,900 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-21 20:12:04,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689970324900 (current time:1689970324900). 2023-07-21 20:12:04,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-21 20:12:04,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] zookeeper.ReadOnlyZKClient(139): Connect 0x73640153 to 127.0.0.1:59101 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 20:12:04,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2f8e934, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 20:12:04,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 20:12:04,960 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44614, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 20:12:04,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x73640153 to 127.0.0.1:59101 2023-07-21 20:12:04,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 20:12:04,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] zookeeper.ReadOnlyZKClient(139): Connect 0x4c20b513 to 127.0.0.1:59101 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 20:12:04,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1f1d5b5d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 20:12:05,001 DEBUG [hconnection-0x5a69b0c3-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 20:12:05,002 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44620, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 20:12:05,010 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 20:12:05,011 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49550, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 20:12:05,013 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4c20b513 to 127.0.0.1:59101 2023-07-21 20:12:05,013 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 20:12:05,013 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-21 20:12:05,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-21 20:12:05,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-21 20:12:05,018 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-21 20:12:05,031 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-21 20:12:05,034 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689970925034 2023-07-21 20:12:05,034 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-21 20:12:05,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-21 20:12:05,037 DEBUG [Listener at jenkins-hbase4.apache.org/38105] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-21 20:12:05,037 DEBUG [Listener at jenkins-hbase4.apache.org/38105] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-21 20:12:05,039 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-21 20:12:05,041 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-21 20:12:05,043 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 25 msec 2023-07-21 20:12:05,045 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-21 20:12:05,046 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689970925046 2023-07-21 20:12:05,097 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:05,097 INFO [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-07-21 20:12:05,098 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 20:12:05,099 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-21 20:12:05,099 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-21 20:12:05,100 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:05,100 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:05,101 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:12:05,101 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:12:05,101 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:12:05,102 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:12:05,102 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:12:05,102 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:12:05,102 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:12:05,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:12:05,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:12:05,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:12:05,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:05,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:05,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:05,102 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:12:05,102 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:12:05,103 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:05,103 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:05,103 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:12:05,103 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-21 20:12:05,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-21 20:12:05,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:05,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-21 20:12:05,103 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:05,103 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-21 20:12:05,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:05,104 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-21 20:12:05,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-21 20:12:05,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:05,104 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-21 20:12:05,109 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:05,109 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-21 20:12:05,109 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 20:12:05,109 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:05,109 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-21 20:12:05,109 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 20:12:05,112 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-21 20:12:05,112 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-21 20:12:05,112 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:05,112 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-21 20:12:05,112 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-21 20:12:05,112 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37823,1689970216018' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-21 20:12:05,112 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-21 20:12:05,112 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34071,1689970216065' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-21 20:12:05,112 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 20:12:05,117 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-21 20:12:05,117 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-21 20:12:05,117 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40099,1689970215928' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-21 20:12:05,118 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:12:05,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:12:05,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 20:12:05,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 20:12:05,119 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:05,119 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:05,120 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:05,120 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:12:05,121 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:05,121 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:05,121 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 20:12:05,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 20:12:05,121 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 20:12:05,121 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:05,121 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 20:12:05,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 20:12:05,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:05,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:12:05,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:12:05,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:12:05,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 20:12:05,124 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37823,1689970216018' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-21 20:12:05,124 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7400b36a[Count = 1] remaining members to acquire global barrier 2023-07-21 20:12:05,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:12:05,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 20:12:05,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 20:12:05,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 20:12:05,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 20:12:05,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:05,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:12:05,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:12:05,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:12:05,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 20:12:05,127 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40099,1689970215928' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-21 20:12:05,127 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7400b36a[Count = 0] remaining members to acquire global barrier 2023-07-21 20:12:05,127 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-21 20:12:05,127 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:05,131 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:05,131 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:05,131 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:05,131 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:05,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:05,131 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:05,131 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-21 20:12:05,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:05,131 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:05,132 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-21 20:12:05,131 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:12:05,132 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 20:12:05,132 DEBUG [rs(jenkins-hbase4.apache.org,37823,1689970216018)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689970323075.96d9ce9c7a0da6d2b8c60f848e67a6e2. 2023-07-21 20:12:05,132 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 20:12:05,132 DEBUG [rs(jenkins-hbase4.apache.org,37823,1689970216018)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689970323075.96d9ce9c7a0da6d2b8c60f848e67a6e2. started... 2023-07-21 20:12:05,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:05,132 DEBUG [rs(jenkins-hbase4.apache.org,40099,1689970215928)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689970323075.c4cd11f8915cf34b3b291311fb8d8f70. 2023-07-21 20:12:05,132 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 20:12:05,132 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:12:05,132 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-21 20:12:05,132 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 20:12:05,132 INFO [rs(jenkins-hbase4.apache.org,37823,1689970216018)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 96d9ce9c7a0da6d2b8c60f848e67a6e2 1/1 column families, dataSize=467 B heapSize=1.23 KB 2023-07-21 20:12:05,132 DEBUG [rs(jenkins-hbase4.apache.org,40099,1689970215928)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689970323075.c4cd11f8915cf34b3b291311fb8d8f70. started... 2023-07-21 20:12:05,132 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-21 20:12:05,132 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-21 20:12:05,132 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,34071,1689970216065' in zk 2023-07-21 20:12:05,132 INFO [rs(jenkins-hbase4.apache.org,40099,1689970215928)-snapshot-pool-0] regionserver.HRegion(2745): Flushing c4cd11f8915cf34b3b291311fb8d8f70 1/1 column families, dataSize=2.80 KB heapSize=6.30 KB 2023-07-21 20:12:05,137 DEBUG [Listener at jenkins-hbase4.apache.org/38105] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 20:12:05,137 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-21 20:12:05,137 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 20:12:05,137 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-21 20:12:05,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-21 20:12:05,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-21 20:12:05,139 DEBUG [Listener at jenkins-hbase4.apache.org/38105] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-21 20:12:05,175 INFO [rs(jenkins-hbase4.apache.org,37823,1689970216018)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307219757f66d0bf2461ca82bcbab9463e3b7 to hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202307219757f66d0bf2461ca82bcbab9463e3b7 2023-07-21 20:12:05,186 INFO [rs(jenkins-hbase4.apache.org,40099,1689970215928)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202307215363b6168df544728f52f7bfde6d0502 to hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202307215363b6168df544728f52f7bfde6d0502 2023-07-21 20:12:05,207 INFO [rs(jenkins-hbase4.apache.org,37823,1689970216018)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=467, hasBloomFilter=true, into tmp file hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testEmptyExportFileSystemState/96d9ce9c7a0da6d2b8c60f848e67a6e2/.tmp/cf/74cd2f52b0f64e5cba5d1b82ef7a8b9e 2023-07-21 20:12:05,214 DEBUG [rs(jenkins-hbase4.apache.org,37823,1689970216018)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testEmptyExportFileSystemState/96d9ce9c7a0da6d2b8c60f848e67a6e2/.tmp/cf/74cd2f52b0f64e5cba5d1b82ef7a8b9e as hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testEmptyExportFileSystemState/96d9ce9c7a0da6d2b8c60f848e67a6e2/cf/74cd2f52b0f64e5cba5d1b82ef7a8b9e 2023-07-21 20:12:05,219 INFO [rs(jenkins-hbase4.apache.org,37823,1689970216018)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testEmptyExportFileSystemState/96d9ce9c7a0da6d2b8c60f848e67a6e2/cf/74cd2f52b0f64e5cba5d1b82ef7a8b9e, entries=7, sequenceid=6, filesize=6.1 K 2023-07-21 20:12:05,225 INFO [rs(jenkins-hbase4.apache.org,40099,1689970215928)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.8 K, hasBloomFilter=true, into tmp file hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testEmptyExportFileSystemState/c4cd11f8915cf34b3b291311fb8d8f70/.tmp/cf/97239dba4bda4dfab3ed83595f8f7d26 2023-07-21 20:12:05,226 INFO [rs(jenkins-hbase4.apache.org,37823,1689970216018)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~467 B/467, heapSize ~1.22 KB/1248, currentSize=0 B/0 for 96d9ce9c7a0da6d2b8c60f848e67a6e2 in 94ms, sequenceid=6, compaction requested=false 2023-07-21 20:12:05,226 DEBUG [rs(jenkins-hbase4.apache.org,37823,1689970216018)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-07-21 20:12:05,226 DEBUG [rs(jenkins-hbase4.apache.org,37823,1689970216018)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 96d9ce9c7a0da6d2b8c60f848e67a6e2: 2023-07-21 20:12:05,227 DEBUG [rs(jenkins-hbase4.apache.org,37823,1689970216018)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689970323075.96d9ce9c7a0da6d2b8c60f848e67a6e2.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:05,227 DEBUG [rs(jenkins-hbase4.apache.org,37823,1689970216018)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 20:12:05,227 DEBUG [rs(jenkins-hbase4.apache.org,37823,1689970216018)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testEmptyExportFileSystemState/96d9ce9c7a0da6d2b8c60f848e67a6e2/cf/74cd2f52b0f64e5cba5d1b82ef7a8b9e] hfiles 2023-07-21 20:12:05,227 DEBUG [rs(jenkins-hbase4.apache.org,37823,1689970216018)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testEmptyExportFileSystemState/96d9ce9c7a0da6d2b8c60f848e67a6e2/cf/74cd2f52b0f64e5cba5d1b82ef7a8b9e for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:05,232 DEBUG [rs(jenkins-hbase4.apache.org,40099,1689970215928)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testEmptyExportFileSystemState/c4cd11f8915cf34b3b291311fb8d8f70/.tmp/cf/97239dba4bda4dfab3ed83595f8f7d26 as hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testEmptyExportFileSystemState/c4cd11f8915cf34b3b291311fb8d8f70/cf/97239dba4bda4dfab3ed83595f8f7d26 2023-07-21 20:12:05,252 INFO [rs(jenkins-hbase4.apache.org,40099,1689970215928)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testEmptyExportFileSystemState/c4cd11f8915cf34b3b291311fb8d8f70/cf/97239dba4bda4dfab3ed83595f8f7d26, entries=43, sequenceid=6, filesize=12.4 K 2023-07-21 20:12:05,253 INFO [rs(jenkins-hbase4.apache.org,40099,1689970215928)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.80 KB/2869, heapSize ~6.28 KB/6432, currentSize=0 B/0 for c4cd11f8915cf34b3b291311fb8d8f70 in 121ms, sequenceid=6, compaction requested=false 2023-07-21 20:12:05,268 DEBUG [rs(jenkins-hbase4.apache.org,40099,1689970215928)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c4cd11f8915cf34b3b291311fb8d8f70: 2023-07-21 20:12:05,268 DEBUG [rs(jenkins-hbase4.apache.org,40099,1689970215928)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689970323075.c4cd11f8915cf34b3b291311fb8d8f70.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:05,270 DEBUG [rs(jenkins-hbase4.apache.org,40099,1689970215928)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 20:12:05,270 DEBUG [rs(jenkins-hbase4.apache.org,40099,1689970215928)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testEmptyExportFileSystemState/c4cd11f8915cf34b3b291311fb8d8f70/cf/97239dba4bda4dfab3ed83595f8f7d26] hfiles 2023-07-21 20:12:05,270 DEBUG [rs(jenkins-hbase4.apache.org,40099,1689970215928)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testEmptyExportFileSystemState/c4cd11f8915cf34b3b291311fb8d8f70/cf/97239dba4bda4dfab3ed83595f8f7d26 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:05,309 DEBUG [rs(jenkins-hbase4.apache.org,37823,1689970216018)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689970323075.96d9ce9c7a0da6d2b8c60f848e67a6e2. completed. 2023-07-21 20:12:05,309 DEBUG [rs(jenkins-hbase4.apache.org,37823,1689970216018)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689970323075.96d9ce9c7a0da6d2b8c60f848e67a6e2. 2023-07-21 20:12:05,309 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 20:12:05,310 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 20:12:05,310 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:12:05,310 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-21 20:12:05,310 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,37823,1689970216018' in zk 2023-07-21 20:12:05,313 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:12:05,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:12:05,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 20:12:05,313 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-21 20:12:05,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 20:12:05,313 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 20:12:05,313 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-21 20:12:05,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 20:12:05,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 20:12:05,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:05,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:12:05,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:12:05,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:12:05,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 20:12:05,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:05,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:12:05,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:12:05,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,37823,1689970216018': 2023-07-21 20:12:05,321 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37823,1689970216018' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-21 20:12:05,339 DEBUG [Listener at jenkins-hbase4.apache.org/38105] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 20:12:05,341 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-21 20:12:05,341 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-21 20:12:05,342 DEBUG [Listener at jenkins-hbase4.apache.org/38105] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-21 20:12:05,348 DEBUG [rs(jenkins-hbase4.apache.org,40099,1689970215928)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689970323075.c4cd11f8915cf34b3b291311fb8d8f70. completed. 2023-07-21 20:12:05,349 DEBUG [rs(jenkins-hbase4.apache.org,40099,1689970215928)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689970323075.c4cd11f8915cf34b3b291311fb8d8f70. 2023-07-21 20:12:05,354 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 20:12:05,354 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 20:12:05,355 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:12:05,355 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-21 20:12:05,355 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40099,1689970215928' in zk 2023-07-21 20:12:05,357 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-21 20:12:05,357 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:12:05,358 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 20:12:05,358 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-21 20:12:05,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:12:05,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 20:12:05,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 20:12:05,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 20:12:05,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 20:12:05,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:05,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:12:05,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:12:05,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:12:05,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 20:12:05,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:05,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:12:05,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:12:05,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:12:05,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,40099,1689970215928': 2023-07-21 20:12:05,369 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40099,1689970215928' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-21 20:12:05,369 INFO [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-07-21 20:12:05,369 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-21 20:12:05,369 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-21 20:12:05,369 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:05,369 INFO [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-21 20:12:05,373 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:05,373 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:05,373 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:05,373 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:05,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:05,373 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:12:05,374 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:05,374 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:05,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:05,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 20:12:05,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 20:12:05,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:05,373 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:12:05,374 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:05,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:05,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 20:12:05,375 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:12:05,374 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:12:05,375 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:12:05,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:12:05,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:12:05,375 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:12:05,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:12:05,375 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:12:05,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:05,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:05,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:05,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:05,382 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:12:05,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 20:12:05,383 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:12:05,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:05,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:12:05,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:12:05,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:12:05,385 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:12:05,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 20:12:05,386 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:12:05,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:05,386 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:12:05,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:12:05,390 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 20:12:05,390 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:12:05,390 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:12:05,390 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:12:05,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:12:05,390 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:12:05,392 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:12:05,392 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:12:05,390 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:12:05,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:12:05,392 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:05,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:12:05,390 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:05,393 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:12:05,393 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-07-21 20:12:05,392 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:12:05,393 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:05,392 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:12:05,392 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:12:05,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:12:05,393 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-21 20:12:05,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:12:05,393 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:12:05,393 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:05,393 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:12:05,393 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:05,393 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:12:05,393 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:12:05,393 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:05,394 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:05,394 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:12:05,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:12:05,394 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:12:05,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:12:05,394 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202307215363b6168df544728f52f7bfde6d0502, hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202307219757f66d0bf2461ca82bcbab9463e3b7] mob files 2023-07-21 20:12:05,394 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:12:05,394 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202307215363b6168df544728f52f7bfde6d0502 2023-07-21 20:12:05,394 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState because node does not exist (not an error) 2023-07-21 20:12:05,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:12:05,394 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202307219757f66d0bf2461ca82bcbab9463e3b7 2023-07-21 20:12:05,414 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:05,415 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:05,440 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:05,516 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-21 20:12:05,516 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:05,516 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:05,516 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689970325034Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1689970325414 (+380 ms)Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1689970325414Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1689970325415 (+1 ms)Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1689970325422 (+7 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1689970325432 (+10 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689970325516 (+84 ms) 2023-07-21 20:12:05,520 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-21 20:12:05,522 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 484 msec 2023-07-21 20:12:05,642 DEBUG [Listener at jenkins-hbase4.apache.org/38105] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 20:12:05,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-21 20:12:05,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-21 20:12:05,643 INFO [Listener at jenkins-hbase4.apache.org/38105] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/export-test/export-1689970325643 2023-07-21 20:12:05,643 INFO [Listener at jenkins-hbase4.apache.org/38105] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:40641, tgtDir=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/export-test/export-1689970325643, rawTgtDir=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/export-test/export-1689970325643, srcFsUri=hdfs://localhost:40641, srcDir=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00 2023-07-21 20:12:05,672 DEBUG [Listener at jenkins-hbase4.apache.org/38105] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:40641, inputRoot=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00 2023-07-21 20:12:05,673 DEBUG [Listener at jenkins-hbase4.apache.org/38105] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-149974212_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/export-test/export-1689970325643, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/export-test/export-1689970325643/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:05,673 INFO [Listener at jenkins-hbase4.apache.org/38105] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:40641, inputRoot=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00, snapshotDir=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-07-21 20:12:05,686 INFO [Listener at jenkins-hbase4.apache.org/38105] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/export-test/export-1689970325643/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:05,746 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-21 20:12:05,747 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-21 20:12:05,748 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-21 20:12:05,748 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-21 20:12:06,399 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689970225203_0005_000001 (auth:SIMPLE) 2023-07-21 20:12:06,959 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c4475fbf-6a12-c189-d7a2-889953ef4b74/hadoop-981877115592054055.jar 2023-07-21 20:12:06,960 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-21 20:12:06,961 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-21 20:12:07,097 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c4475fbf-6a12-c189-d7a2-889953ef4b74/hadoop-3665085299632451898.jar 2023-07-21 20:12:07,098 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-21 20:12:07,099 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-21 20:12:07,100 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-21 20:12:07,100 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-21 20:12:07,101 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-21 20:12:07,101 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-21 20:12:07,102 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-21 20:12:07,102 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-21 20:12:07,121 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-21 20:12:07,122 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-21 20:12:07,122 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-21 20:12:07,123 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-21 20:12:07,124 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-21 20:12:07,124 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-21 20:12:07,124 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-21 20:12:07,125 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-21 20:12:07,126 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 20:12:07,127 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 20:12:07,128 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-21 20:12:07,128 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 20:12:07,129 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 20:12:07,129 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-21 20:12:07,130 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-21 20:12:07,927 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-21 20:12:09,575 WARN [Listener at jenkins-hbase4.apache.org/38105] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-21 20:12:09,592 INFO [Listener at jenkins-hbase4.apache.org/38105] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-07-21 20:12:09,833 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-21 20:12:09,833 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-21 20:12:10,200 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689970225203_0006_000001 (auth:SIMPLE) 2023-07-21 20:12:15,226 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689970225203_0006_000001 (auth:SIMPLE) 2023-07-21 20:12:18,157 INFO [Listener at jenkins-hbase4.apache.org/38105] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-21 20:12:18,158 INFO [Listener at jenkins-hbase4.apache.org/38105] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-21 20:12:18,164 INFO [Listener at jenkins-hbase4.apache.org/38105] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:18,164 INFO [Listener at jenkins-hbase4.apache.org/38105] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-21 20:12:18,165 INFO [Listener at jenkins-hbase4.apache.org/38105] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-21 20:12:18,165 DEBUG [Listener at jenkins-hbase4.apache.org/38105] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_895530006_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:18,165 DEBUG [Listener at jenkins-hbase4.apache.org/38105] snapshot.TestExportSnapshot(367): hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-21 20:12:18,165 DEBUG [Listener at jenkins-hbase4.apache.org/38105] snapshot.TestExportSnapshot(367): hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-21 20:12:18,165 DEBUG [Listener at jenkins-hbase4.apache.org/38105] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_895530006_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/export-test/export-1689970325643/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/export-test/export-1689970325643/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:18,166 DEBUG [Listener at jenkins-hbase4.apache.org/38105] snapshot.TestExportSnapshot(367): hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/export-test/export-1689970325643/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-21 20:12:18,166 DEBUG [Listener at jenkins-hbase4.apache.org/38105] snapshot.TestExportSnapshot(367): hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/export-test/export-1689970325643/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-21 20:12:18,171 INFO [Listener at jenkins-hbase4.apache.org/38105] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-07-21 20:12:18,172 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-07-21 20:12:18,173 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] procedure2.ProcedureExecutor(1029): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-21 20:12:18,176 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-21 20:12:18,177 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689970338176"}]},"ts":"1689970338176"} 2023-07-21 20:12:18,178 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-07-21 20:12:18,181 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-07-21 20:12:18,182 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=96d9ce9c7a0da6d2b8c60f848e67a6e2, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=c4cd11f8915cf34b3b291311fb8d8f70, UNASSIGN}] 2023-07-21 20:12:18,184 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=96d9ce9c7a0da6d2b8c60f848e67a6e2, UNASSIGN 2023-07-21 20:12:18,184 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=c4cd11f8915cf34b3b291311fb8d8f70, UNASSIGN 2023-07-21 20:12:18,185 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=96d9ce9c7a0da6d2b8c60f848e67a6e2, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:12:18,185 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=c4cd11f8915cf34b3b291311fb8d8f70, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:12:18,185 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689970323075.96d9ce9c7a0da6d2b8c60f848e67a6e2.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689970338185"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689970338185"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689970338185"}]},"ts":"1689970338185"} 2023-07-21 20:12:18,185 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689970323075.c4cd11f8915cf34b3b291311fb8d8f70.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689970338185"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689970338185"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689970338185"}]},"ts":"1689970338185"} 2023-07-21 20:12:18,190 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; CloseRegionProcedure 96d9ce9c7a0da6d2b8c60f848e67a6e2, server=jenkins-hbase4.apache.org,37823,1689970216018}] 2023-07-21 20:12:18,191 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=101, state=RUNNABLE; CloseRegionProcedure c4cd11f8915cf34b3b291311fb8d8f70, server=jenkins-hbase4.apache.org,40099,1689970215928}] 2023-07-21 20:12:18,278 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-21 20:12:18,343 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 96d9ce9c7a0da6d2b8c60f848e67a6e2 2023-07-21 20:12:18,343 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 96d9ce9c7a0da6d2b8c60f848e67a6e2, disabling compactions & flushes 2023-07-21 20:12:18,343 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689970323075.96d9ce9c7a0da6d2b8c60f848e67a6e2. 2023-07-21 20:12:18,343 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689970323075.96d9ce9c7a0da6d2b8c60f848e67a6e2. 2023-07-21 20:12:18,343 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689970323075.96d9ce9c7a0da6d2b8c60f848e67a6e2. after waiting 0 ms 2023-07-21 20:12:18,343 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689970323075.96d9ce9c7a0da6d2b8c60f848e67a6e2. 2023-07-21 20:12:18,344 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close c4cd11f8915cf34b3b291311fb8d8f70 2023-07-21 20:12:18,346 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c4cd11f8915cf34b3b291311fb8d8f70, disabling compactions & flushes 2023-07-21 20:12:18,346 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689970323075.c4cd11f8915cf34b3b291311fb8d8f70. 2023-07-21 20:12:18,349 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689970323075.c4cd11f8915cf34b3b291311fb8d8f70. 2023-07-21 20:12:18,349 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689970323075.c4cd11f8915cf34b3b291311fb8d8f70. after waiting 0 ms 2023-07-21 20:12:18,349 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689970323075.c4cd11f8915cf34b3b291311fb8d8f70. 2023-07-21 20:12:18,367 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testEmptyExportFileSystemState/c4cd11f8915cf34b3b291311fb8d8f70/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-21 20:12:18,368 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 20:12:18,370 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689970323075.c4cd11f8915cf34b3b291311fb8d8f70. 2023-07-21 20:12:18,370 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c4cd11f8915cf34b3b291311fb8d8f70: 2023-07-21 20:12:18,371 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed c4cd11f8915cf34b3b291311fb8d8f70 2023-07-21 20:12:18,372 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testEmptyExportFileSystemState/96d9ce9c7a0da6d2b8c60f848e67a6e2/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-21 20:12:18,372 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=c4cd11f8915cf34b3b291311fb8d8f70, regionState=CLOSED 2023-07-21 20:12:18,372 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689970323075.c4cd11f8915cf34b3b291311fb8d8f70.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689970338372"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689970338372"}]},"ts":"1689970338372"} 2023-07-21 20:12:18,373 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 20:12:18,374 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689970323075.96d9ce9c7a0da6d2b8c60f848e67a6e2. 2023-07-21 20:12:18,374 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 96d9ce9c7a0da6d2b8c60f848e67a6e2: 2023-07-21 20:12:18,375 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 96d9ce9c7a0da6d2b8c60f848e67a6e2 2023-07-21 20:12:18,376 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=96d9ce9c7a0da6d2b8c60f848e67a6e2, regionState=CLOSED 2023-07-21 20:12:18,376 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689970323075.96d9ce9c7a0da6d2b8c60f848e67a6e2.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689970338376"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689970338376"}]},"ts":"1689970338376"} 2023-07-21 20:12:18,380 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=101 2023-07-21 20:12:18,380 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=101, state=SUCCESS; CloseRegionProcedure c4cd11f8915cf34b3b291311fb8d8f70, server=jenkins-hbase4.apache.org,40099,1689970215928 in 187 msec 2023-07-21 20:12:18,382 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=100 2023-07-21 20:12:18,382 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=100, state=SUCCESS; CloseRegionProcedure 96d9ce9c7a0da6d2b8c60f848e67a6e2, server=jenkins-hbase4.apache.org,37823,1689970216018 in 189 msec 2023-07-21 20:12:18,382 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=c4cd11f8915cf34b3b291311fb8d8f70, UNASSIGN in 198 msec 2023-07-21 20:12:18,384 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=100, resume processing ppid=99 2023-07-21 20:12:18,384 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=96d9ce9c7a0da6d2b8c60f848e67a6e2, UNASSIGN in 200 msec 2023-07-21 20:12:18,384 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689970338384"}]},"ts":"1689970338384"} 2023-07-21 20:12:18,385 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-07-21 20:12:18,387 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-07-21 20:12:18,388 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 215 msec 2023-07-21 20:12:18,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-21 20:12:18,479 INFO [Listener at jenkins-hbase4.apache.org/38105] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-07-21 20:12:18,480 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-07-21 20:12:18,481 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-21 20:12:18,484 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-21 20:12:18,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-07-21 20:12:18,485 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-21 20:12:18,486 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37823] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-07-21 20:12:18,489 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testEmptyExportFileSystemState/c4cd11f8915cf34b3b291311fb8d8f70 2023-07-21 20:12:18,489 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testEmptyExportFileSystemState/96d9ce9c7a0da6d2b8c60f848e67a6e2 2023-07-21 20:12:18,490 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-21 20:12:18,490 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-21 20:12:18,490 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-21 20:12:18,491 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-21 20:12:18,491 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-21 20:12:18,491 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-21 20:12:18,491 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-21 20:12:18,491 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-21 20:12:18,492 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testEmptyExportFileSystemState/c4cd11f8915cf34b3b291311fb8d8f70/cf, FileablePath, hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testEmptyExportFileSystemState/c4cd11f8915cf34b3b291311fb8d8f70/recovered.edits] 2023-07-21 20:12:18,492 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-21 20:12:18,492 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-21 20:12:18,492 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 20:12:18,492 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 20:12:18,492 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-21 20:12:18,492 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 20:12:18,492 DEBUG [HFileArchiver-21] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testEmptyExportFileSystemState/96d9ce9c7a0da6d2b8c60f848e67a6e2/cf, FileablePath, hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testEmptyExportFileSystemState/96d9ce9c7a0da6d2b8c60f848e67a6e2/recovered.edits] 2023-07-21 20:12:18,492 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-21 20:12:18,493 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 20:12:18,493 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-21 20:12:18,497 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testEmptyExportFileSystemState/c4cd11f8915cf34b3b291311fb8d8f70/cf/97239dba4bda4dfab3ed83595f8f7d26 to hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/archive/data/default/testtb-testEmptyExportFileSystemState/c4cd11f8915cf34b3b291311fb8d8f70/cf/97239dba4bda4dfab3ed83595f8f7d26 2023-07-21 20:12:18,498 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testEmptyExportFileSystemState/96d9ce9c7a0da6d2b8c60f848e67a6e2/cf/74cd2f52b0f64e5cba5d1b82ef7a8b9e to hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/archive/data/default/testtb-testEmptyExportFileSystemState/96d9ce9c7a0da6d2b8c60f848e67a6e2/cf/74cd2f52b0f64e5cba5d1b82ef7a8b9e 2023-07-21 20:12:18,502 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testEmptyExportFileSystemState/c4cd11f8915cf34b3b291311fb8d8f70/recovered.edits/9.seqid to hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/archive/data/default/testtb-testEmptyExportFileSystemState/c4cd11f8915cf34b3b291311fb8d8f70/recovered.edits/9.seqid 2023-07-21 20:12:18,502 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testEmptyExportFileSystemState/96d9ce9c7a0da6d2b8c60f848e67a6e2/recovered.edits/9.seqid to hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/archive/data/default/testtb-testEmptyExportFileSystemState/96d9ce9c7a0da6d2b8c60f848e67a6e2/recovered.edits/9.seqid 2023-07-21 20:12:18,502 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testEmptyExportFileSystemState/c4cd11f8915cf34b3b291311fb8d8f70 2023-07-21 20:12:18,503 DEBUG [HFileArchiver-21] backup.HFileArchiver(596): Deleted hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testEmptyExportFileSystemState/96d9ce9c7a0da6d2b8c60f848e67a6e2 2023-07-21 20:12:18,503 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-21 20:12:18,503 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-07-21 20:12:18,504 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf] 2023-07-21 20:12:18,507 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202307215363b6168df544728f52f7bfde6d0502 to hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202307215363b6168df544728f52f7bfde6d0502 2023-07-21 20:12:18,509 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202307219757f66d0bf2461ca82bcbab9463e3b7 to hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202307219757f66d0bf2461ca82bcbab9463e3b7 2023-07-21 20:12:18,509 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-07-21 20:12:18,511 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-21 20:12:18,514 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-07-21 20:12:18,516 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-07-21 20:12:18,517 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-21 20:12:18,517 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-07-21 20:12:18,517 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1689970323075.96d9ce9c7a0da6d2b8c60f848e67a6e2.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689970338517"}]},"ts":"9223372036854775807"} 2023-07-21 20:12:18,517 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1689970323075.c4cd11f8915cf34b3b291311fb8d8f70.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689970338517"}]},"ts":"9223372036854775807"} 2023-07-21 20:12:18,523 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-21 20:12:18,523 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 96d9ce9c7a0da6d2b8c60f848e67a6e2, NAME => 'testtb-testEmptyExportFileSystemState,,1689970323075.96d9ce9c7a0da6d2b8c60f848e67a6e2.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => c4cd11f8915cf34b3b291311fb8d8f70, NAME => 'testtb-testEmptyExportFileSystemState,1,1689970323075.c4cd11f8915cf34b3b291311fb8d8f70.', STARTKEY => '1', ENDKEY => ''}] 2023-07-21 20:12:18,523 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-07-21 20:12:18,523 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689970338523"}]},"ts":"9223372036854775807"} 2023-07-21 20:12:18,524 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-07-21 20:12:18,526 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-21 20:12:18,527 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 46 msec 2023-07-21 20:12:18,596 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-21 20:12:18,597 INFO [Listener at jenkins-hbase4.apache.org/38105] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-07-21 20:12:18,617 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-07-21 20:12:18,619 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:18,621 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-07-21 20:12:18,623 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:18,672 INFO [Listener at jenkins-hbase4.apache.org/38105] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=764 (was 758) Potentially hanging thread: hconnection-0x3e3f9760-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3e3f9760-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3e3f9760-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_895530006_17 at /127.0.0.1:56430 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_895530006_17 at /127.0.0.1:59820 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3e3f9760-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1359120789_1 at /127.0.0.1:56406 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_895530006_17 at /127.0.0.1:50388 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4904 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: IPC Client (1354340851) connection to jenkins-hbase4.apache.org/172.31.14.131:39775 from appattempt_1689970225203_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1359120789_1 at /127.0.0.1:59766 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-21 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1354340851) connection to jenkins-hbase4.apache.org/172.31.14.131:43429 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) - Thread LEAK? -, OpenFileDescriptor=923 (was 915) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=462 (was 413) - SystemLoadAverage LEAK? -, ProcessCount=184 (was 184), AvailableMemoryMB=6759 (was 6677) - AvailableMemoryMB LEAK? - 2023-07-21 20:12:18,673 WARN [Listener at jenkins-hbase4.apache.org/38105] hbase.ResourceChecker(130): Thread=764 is superior to 500 2023-07-21 20:12:18,706 INFO [Listener at jenkins-hbase4.apache.org/38105] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=764, OpenFileDescriptor=923, MaxFileDescriptor=60000, SystemLoadAverage=462, ProcessCount=184, AvailableMemoryMB=6750 2023-07-21 20:12:18,706 WARN [Listener at jenkins-hbase4.apache.org/38105] hbase.ResourceChecker(130): Thread=764 is superior to 500 2023-07-21 20:12:18,708 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-21 20:12:18,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:18,712 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-07-21 20:12:18,713 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-07-21 20:12:18,714 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-21 20:12:18,714 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-21 20:12:18,717 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/af48fddb17722592770c99949e6c1521 2023-07-21 20:12:18,717 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/312a6ccf56bb15fc405ce942794e813d 2023-07-21 20:12:18,718 DEBUG [HFileArchiver-13] backup.HFileArchiver(153): Directory hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/af48fddb17722592770c99949e6c1521 empty. 2023-07-21 20:12:18,718 DEBUG [HFileArchiver-13] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/af48fddb17722592770c99949e6c1521 2023-07-21 20:12:18,719 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/312a6ccf56bb15fc405ce942794e813d empty. 2023-07-21 20:12:18,719 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/312a6ccf56bb15fc405ce942794e813d 2023-07-21 20:12:18,719 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-21 20:12:18,791 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-07-21 20:12:18,793 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => 312a6ccf56bb15fc405ce942794e813d, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689970338708.312a6ccf56bb15fc405ce942794e813d.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp 2023-07-21 20:12:18,795 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => af48fddb17722592770c99949e6c1521, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689970338708.af48fddb17722592770c99949e6c1521.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp 2023-07-21 20:12:18,815 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689970338708.af48fddb17722592770c99949e6c1521.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 20:12:18,815 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-21 20:12:18,815 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing af48fddb17722592770c99949e6c1521, disabling compactions & flushes 2023-07-21 20:12:18,815 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689970338708.af48fddb17722592770c99949e6c1521. 2023-07-21 20:12:18,815 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689970338708.af48fddb17722592770c99949e6c1521. 2023-07-21 20:12:18,815 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689970338708.af48fddb17722592770c99949e6c1521. after waiting 0 ms 2023-07-21 20:12:18,816 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689970338708.af48fddb17722592770c99949e6c1521. 2023-07-21 20:12:18,816 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689970338708.af48fddb17722592770c99949e6c1521. 2023-07-21 20:12:18,816 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for af48fddb17722592770c99949e6c1521: 2023-07-21 20:12:18,831 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689970338708.312a6ccf56bb15fc405ce942794e813d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 20:12:18,831 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing 312a6ccf56bb15fc405ce942794e813d, disabling compactions & flushes 2023-07-21 20:12:18,831 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689970338708.312a6ccf56bb15fc405ce942794e813d. 2023-07-21 20:12:18,831 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689970338708.312a6ccf56bb15fc405ce942794e813d. 2023-07-21 20:12:18,831 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689970338708.312a6ccf56bb15fc405ce942794e813d. after waiting 0 ms 2023-07-21 20:12:18,831 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689970338708.312a6ccf56bb15fc405ce942794e813d. 2023-07-21 20:12:18,831 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689970338708.312a6ccf56bb15fc405ce942794e813d. 2023-07-21 20:12:18,831 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for 312a6ccf56bb15fc405ce942794e813d: 2023-07-21 20:12:18,833 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-07-21 20:12:18,835 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689970338708.af48fddb17722592770c99949e6c1521.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689970338834"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689970338834"}]},"ts":"1689970338834"} 2023-07-21 20:12:18,835 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689970338708.312a6ccf56bb15fc405ce942794e813d.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689970338834"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689970338834"}]},"ts":"1689970338834"} 2023-07-21 20:12:18,843 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-21 20:12:18,844 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-21 20:12:18,845 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689970338845"}]},"ts":"1689970338845"} 2023-07-21 20:12:18,847 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-07-21 20:12:18,852 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-21 20:12:18,854 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-21 20:12:18,854 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-21 20:12:18,854 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-21 20:12:18,854 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-21 20:12:18,855 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=af48fddb17722592770c99949e6c1521, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=312a6ccf56bb15fc405ce942794e813d, ASSIGN}] 2023-07-21 20:12:18,858 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=af48fddb17722592770c99949e6c1521, ASSIGN 2023-07-21 20:12:18,858 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=312a6ccf56bb15fc405ce942794e813d, ASSIGN 2023-07-21 20:12:18,860 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=af48fddb17722592770c99949e6c1521, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40099,1689970215928; forceNewPlan=false, retain=false 2023-07-21 20:12:18,861 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=312a6ccf56bb15fc405ce942794e813d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34071,1689970216065; forceNewPlan=false, retain=false 2023-07-21 20:12:19,010 INFO [jenkins-hbase4:41777] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-21 20:12:19,014 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=af48fddb17722592770c99949e6c1521, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:12:19,014 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689970338708.af48fddb17722592770c99949e6c1521.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689970339014"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689970339014"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689970339014"}]},"ts":"1689970339014"} 2023-07-21 20:12:19,015 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=312a6ccf56bb15fc405ce942794e813d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:12:19,015 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689970338708.312a6ccf56bb15fc405ce942794e813d.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689970339015"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689970339015"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689970339015"}]},"ts":"1689970339015"} 2023-07-21 20:12:19,017 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=108, ppid=106, state=RUNNABLE; OpenRegionProcedure af48fddb17722592770c99949e6c1521, server=jenkins-hbase4.apache.org,40099,1689970215928}] 2023-07-21 20:12:19,018 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=107, state=RUNNABLE; OpenRegionProcedure 312a6ccf56bb15fc405ce942794e813d, server=jenkins-hbase4.apache.org,34071,1689970216065}] 2023-07-21 20:12:19,028 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-21 20:12:19,175 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1689970338708.af48fddb17722592770c99949e6c1521. 2023-07-21 20:12:19,175 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => af48fddb17722592770c99949e6c1521, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689970338708.af48fddb17722592770c99949e6c1521.', STARTKEY => '', ENDKEY => '1'} 2023-07-21 20:12:19,176 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1689970338708.af48fddb17722592770c99949e6c1521. service=AccessControlService 2023-07-21 20:12:19,176 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 20:12:19,176 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp af48fddb17722592770c99949e6c1521 2023-07-21 20:12:19,176 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689970338708.af48fddb17722592770c99949e6c1521.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 20:12:19,176 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for af48fddb17722592770c99949e6c1521 2023-07-21 20:12:19,176 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for af48fddb17722592770c99949e6c1521 2023-07-21 20:12:19,177 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1689970338708.312a6ccf56bb15fc405ce942794e813d. 2023-07-21 20:12:19,177 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 312a6ccf56bb15fc405ce942794e813d, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689970338708.312a6ccf56bb15fc405ce942794e813d.', STARTKEY => '1', ENDKEY => ''} 2023-07-21 20:12:19,177 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1689970338708.312a6ccf56bb15fc405ce942794e813d. service=AccessControlService 2023-07-21 20:12:19,177 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 20:12:19,178 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 312a6ccf56bb15fc405ce942794e813d 2023-07-21 20:12:19,178 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689970338708.312a6ccf56bb15fc405ce942794e813d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 20:12:19,178 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 312a6ccf56bb15fc405ce942794e813d 2023-07-21 20:12:19,178 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 312a6ccf56bb15fc405ce942794e813d 2023-07-21 20:12:19,179 INFO [StoreOpener-af48fddb17722592770c99949e6c1521-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region af48fddb17722592770c99949e6c1521 2023-07-21 20:12:19,180 DEBUG [StoreOpener-af48fddb17722592770c99949e6c1521-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testExportFileSystemStateWithSkipTmp/af48fddb17722592770c99949e6c1521/cf 2023-07-21 20:12:19,180 DEBUG [StoreOpener-af48fddb17722592770c99949e6c1521-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testExportFileSystemStateWithSkipTmp/af48fddb17722592770c99949e6c1521/cf 2023-07-21 20:12:19,181 INFO [StoreOpener-af48fddb17722592770c99949e6c1521-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region af48fddb17722592770c99949e6c1521 columnFamilyName cf 2023-07-21 20:12:19,182 INFO [StoreOpener-af48fddb17722592770c99949e6c1521-1] regionserver.HStore(310): Store=af48fddb17722592770c99949e6c1521/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 20:12:19,183 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testExportFileSystemStateWithSkipTmp/af48fddb17722592770c99949e6c1521 2023-07-21 20:12:19,184 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testExportFileSystemStateWithSkipTmp/af48fddb17722592770c99949e6c1521 2023-07-21 20:12:19,185 INFO [StoreOpener-312a6ccf56bb15fc405ce942794e813d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 312a6ccf56bb15fc405ce942794e813d 2023-07-21 20:12:19,186 DEBUG [StoreOpener-312a6ccf56bb15fc405ce942794e813d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testExportFileSystemStateWithSkipTmp/312a6ccf56bb15fc405ce942794e813d/cf 2023-07-21 20:12:19,186 DEBUG [StoreOpener-312a6ccf56bb15fc405ce942794e813d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testExportFileSystemStateWithSkipTmp/312a6ccf56bb15fc405ce942794e813d/cf 2023-07-21 20:12:19,186 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for af48fddb17722592770c99949e6c1521 2023-07-21 20:12:19,187 INFO [StoreOpener-312a6ccf56bb15fc405ce942794e813d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 312a6ccf56bb15fc405ce942794e813d columnFamilyName cf 2023-07-21 20:12:19,188 INFO [StoreOpener-312a6ccf56bb15fc405ce942794e813d-1] regionserver.HStore(310): Store=312a6ccf56bb15fc405ce942794e813d/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 20:12:19,189 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testExportFileSystemStateWithSkipTmp/312a6ccf56bb15fc405ce942794e813d 2023-07-21 20:12:19,190 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testExportFileSystemStateWithSkipTmp/312a6ccf56bb15fc405ce942794e813d 2023-07-21 20:12:19,190 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testExportFileSystemStateWithSkipTmp/af48fddb17722592770c99949e6c1521/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-21 20:12:19,191 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened af48fddb17722592770c99949e6c1521; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60349629, jitterRate=-0.10072045028209686}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-21 20:12:19,191 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for af48fddb17722592770c99949e6c1521: 2023-07-21 20:12:19,192 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1689970338708.af48fddb17722592770c99949e6c1521., pid=108, masterSystemTime=1689970339170 2023-07-21 20:12:19,193 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 312a6ccf56bb15fc405ce942794e813d 2023-07-21 20:12:19,194 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1689970338708.af48fddb17722592770c99949e6c1521. 2023-07-21 20:12:19,194 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1689970338708.af48fddb17722592770c99949e6c1521. 2023-07-21 20:12:19,195 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=af48fddb17722592770c99949e6c1521, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:12:19,195 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689970338708.af48fddb17722592770c99949e6c1521.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689970339195"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689970339195"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689970339195"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689970339195"}]},"ts":"1689970339195"} 2023-07-21 20:12:19,198 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=108, resume processing ppid=106 2023-07-21 20:12:19,198 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=106, state=SUCCESS; OpenRegionProcedure af48fddb17722592770c99949e6c1521, server=jenkins-hbase4.apache.org,40099,1689970215928 in 179 msec 2023-07-21 20:12:19,204 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=af48fddb17722592770c99949e6c1521, ASSIGN in 344 msec 2023-07-21 20:12:19,211 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testExportFileSystemStateWithSkipTmp/312a6ccf56bb15fc405ce942794e813d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-21 20:12:19,212 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 312a6ccf56bb15fc405ce942794e813d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74178584, jitterRate=0.10534703731536865}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-21 20:12:19,212 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 312a6ccf56bb15fc405ce942794e813d: 2023-07-21 20:12:19,213 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1689970338708.312a6ccf56bb15fc405ce942794e813d., pid=109, masterSystemTime=1689970339171 2023-07-21 20:12:19,215 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1689970338708.312a6ccf56bb15fc405ce942794e813d. 2023-07-21 20:12:19,215 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1689970338708.312a6ccf56bb15fc405ce942794e813d. 2023-07-21 20:12:19,216 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=312a6ccf56bb15fc405ce942794e813d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:12:19,216 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689970338708.312a6ccf56bb15fc405ce942794e813d.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689970339215"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689970339215"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689970339215"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689970339215"}]},"ts":"1689970339215"} 2023-07-21 20:12:19,221 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=107 2023-07-21 20:12:19,221 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=107, state=SUCCESS; OpenRegionProcedure 312a6ccf56bb15fc405ce942794e813d, server=jenkins-hbase4.apache.org,34071,1689970216065 in 200 msec 2023-07-21 20:12:19,223 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=107, resume processing ppid=105 2023-07-21 20:12:19,223 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=312a6ccf56bb15fc405ce942794e813d, ASSIGN in 366 msec 2023-07-21 20:12:19,224 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-21 20:12:19,224 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689970339224"}]},"ts":"1689970339224"} 2023-07-21 20:12:19,225 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-07-21 20:12:19,228 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-07-21 20:12:19,229 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-07-21 20:12:19,230 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37823] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-21 20:12:19,232 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 20:12:19,232 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 20:12:19,232 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 20:12:19,232 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 20:12:19,233 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-21 20:12:19,234 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-21 20:12:19,234 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-21 20:12:19,234 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-21 20:12:19,240 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 525 msec 2023-07-21 20:12:19,330 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-21 20:12:19,330 INFO [Listener at jenkins-hbase4.apache.org/38105] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-07-21 20:12:19,332 DEBUG [Listener at jenkins-hbase4.apache.org/38105] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:19,332 DEBUG [Listener at jenkins-hbase4.apache.org/38105] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1689970338708.af48fddb17722592770c99949e6c1521. 2023-07-21 20:12:19,334 INFO [Listener at jenkins-hbase4.apache.org/38105] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-21 20:12:19,348 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-21 20:12:19,348 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689970339348 (current time:1689970339348). 2023-07-21 20:12:19,348 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-21 20:12:19,348 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] zookeeper.ReadOnlyZKClient(139): Connect 0x588f78be to 127.0.0.1:59101 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 20:12:19,373 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5598cf8b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 20:12:19,374 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 20:12:19,378 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59856, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 20:12:19,379 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x588f78be to 127.0.0.1:59101 2023-07-21 20:12:19,379 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 20:12:19,380 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] zookeeper.ReadOnlyZKClient(139): Connect 0x73d0bdc1 to 127.0.0.1:59101 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 20:12:19,387 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@50b9618d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 20:12:19,390 DEBUG [hconnection-0x434e0886-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 20:12:19,393 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59858, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 20:12:19,396 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 20:12:19,402 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45472, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 20:12:19,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x73d0bdc1 to 127.0.0.1:59101 2023-07-21 20:12:19,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 20:12:19,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-21 20:12:19,404 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-21 20:12:19,405 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-21 20:12:19,407 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] procedure2.ProcedureExecutor(1029): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-21 20:12:19,409 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-21 20:12:19,409 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689970939409 2023-07-21 20:12:19,409 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-21 20:12:19,410 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:19,411 DEBUG [Listener at jenkins-hbase4.apache.org/38105] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-21 20:12:19,411 DEBUG [Listener at jenkins-hbase4.apache.org/38105] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-21 20:12:19,413 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-21 20:12:19,413 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-21 20:12:19,414 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 7 msec 2023-07-21 20:12:19,415 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-21 20:12:19,416 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689970939416 2023-07-21 20:12:19,437 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:19,437 INFO [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-21 20:12:19,437 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 20:12:19,439 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-21 20:12:19,439 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-21 20:12:19,507 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:19,507 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:19,510 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:12:19,510 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:12:19,510 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:12:19,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:12:19,510 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:12:19,510 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:12:19,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:12:19,510 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:12:19,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:12:19,510 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:12:19,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:19,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:19,511 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:12:19,511 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:12:19,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:19,511 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:12:19,512 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-21 20:12:19,512 DEBUG [Listener at jenkins-hbase4.apache.org/38105] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 20:12:19,512 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:19,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-21 20:12:19,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-21 20:12:19,513 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:19,513 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:19,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-21 20:12:19,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:19,514 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-21 20:12:19,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-21 20:12:19,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:19,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-21 20:12:19,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:19,514 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-21 20:12:19,514 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-21 20:12:19,515 DEBUG [Listener at jenkins-hbase4.apache.org/38105] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-21 20:12:19,516 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:19,517 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-21 20:12:19,517 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 20:12:19,520 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-21 20:12:19,520 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-21 20:12:19,520 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40099,1689970215928' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-21 20:12:19,521 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:19,521 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:19,521 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-21 20:12:19,521 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 20:12:19,521 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-21 20:12:19,525 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 20:12:19,523 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-21 20:12:19,525 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-21 20:12:19,526 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34071,1689970216065' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-21 20:12:19,528 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-21 20:12:19,529 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-21 20:12:19,529 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37823,1689970216018' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-21 20:12:19,531 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:19,531 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:19,531 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 20:12:19,532 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:19,532 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:19,532 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:19,533 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 20:12:19,533 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:19,533 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 20:12:19,536 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:12:19,536 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:12:19,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:12:19,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 20:12:19,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 20:12:19,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 20:12:19,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 20:12:19,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:19,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:12:19,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:12:19,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:12:19,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 20:12:19,544 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40099,1689970215928' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-21 20:12:19,544 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@39e2c976[Count = 1] remaining members to acquire global barrier 2023-07-21 20:12:19,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:12:19,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 20:12:19,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 20:12:19,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 20:12:19,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 20:12:19,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:19,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:12:19,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:12:19,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:12:19,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 20:12:19,547 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34071,1689970216065' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-21 20:12:19,547 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@39e2c976[Count = 0] remaining members to acquire global barrier 2023-07-21 20:12:19,547 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-21 20:12:19,547 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:19,549 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:19,549 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:19,549 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:19,549 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:19,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:19,549 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:19,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:19,550 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:12:19,550 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-21 20:12:19,550 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:19,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:19,550 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-21 20:12:19,550 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-21 20:12:19,550 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-21 20:12:19,550 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,37823,1689970216018' in zk 2023-07-21 20:12:19,550 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:12:19,551 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-21 20:12:19,552 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-21 20:12:19,552 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 20:12:19,552 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-21 20:12:19,576 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 20:12:19,577 DEBUG [rs(jenkins-hbase4.apache.org,34071,1689970216065)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689970338708.312a6ccf56bb15fc405ce942794e813d. 2023-07-21 20:12:19,577 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 20:12:19,577 DEBUG [rs(jenkins-hbase4.apache.org,34071,1689970216065)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689970338708.312a6ccf56bb15fc405ce942794e813d. started... 2023-07-21 20:12:19,579 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 20:12:19,579 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 20:12:19,579 DEBUG [rs(jenkins-hbase4.apache.org,34071,1689970216065)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 312a6ccf56bb15fc405ce942794e813d: 2023-07-21 20:12:19,579 DEBUG [rs(jenkins-hbase4.apache.org,40099,1689970215928)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689970338708.af48fddb17722592770c99949e6c1521. 2023-07-21 20:12:19,579 DEBUG [rs(jenkins-hbase4.apache.org,34071,1689970216065)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689970338708.312a6ccf56bb15fc405ce942794e813d.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:19,579 DEBUG [rs(jenkins-hbase4.apache.org,40099,1689970215928)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689970338708.af48fddb17722592770c99949e6c1521. started... 2023-07-21 20:12:19,580 DEBUG [rs(jenkins-hbase4.apache.org,34071,1689970216065)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 20:12:19,580 DEBUG [rs(jenkins-hbase4.apache.org,34071,1689970216065)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-21 20:12:19,580 DEBUG [rs(jenkins-hbase4.apache.org,40099,1689970215928)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for af48fddb17722592770c99949e6c1521: 2023-07-21 20:12:19,580 DEBUG [rs(jenkins-hbase4.apache.org,40099,1689970215928)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689970338708.af48fddb17722592770c99949e6c1521.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:19,580 DEBUG [rs(jenkins-hbase4.apache.org,40099,1689970215928)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 20:12:19,580 DEBUG [rs(jenkins-hbase4.apache.org,40099,1689970215928)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-21 20:12:19,625 DEBUG [rs(jenkins-hbase4.apache.org,40099,1689970215928)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689970338708.af48fddb17722592770c99949e6c1521. completed. 2023-07-21 20:12:19,625 DEBUG [rs(jenkins-hbase4.apache.org,40099,1689970215928)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689970338708.af48fddb17722592770c99949e6c1521. 2023-07-21 20:12:19,625 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 20:12:19,625 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 20:12:19,625 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:12:19,639 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-21 20:12:19,639 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,40099,1689970215928' in zk 2023-07-21 20:12:19,641 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:12:19,641 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-21 20:12:19,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:12:19,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 20:12:19,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 20:12:19,641 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 20:12:19,641 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-21 20:12:19,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 20:12:19,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 20:12:19,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:19,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:12:19,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:12:19,647 DEBUG [rs(jenkins-hbase4.apache.org,34071,1689970216065)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689970338708.312a6ccf56bb15fc405ce942794e813d. completed. 2023-07-21 20:12:19,647 DEBUG [rs(jenkins-hbase4.apache.org,34071,1689970216065)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689970338708.312a6ccf56bb15fc405ce942794e813d. 2023-07-21 20:12:19,647 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 20:12:19,647 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 20:12:19,647 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:12:19,647 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-21 20:12:19,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:12:19,648 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,34071,1689970216065' in zk 2023-07-21 20:12:19,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 20:12:19,650 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:12:19,650 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-21 20:12:19,650 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 20:12:19,650 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-21 20:12:19,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:19,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:12:19,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:12:19,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:12:19,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,40099,1689970215928': 2023-07-21 20:12:19,653 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40099,1689970215928' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-21 20:12:19,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:12:19,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 20:12:19,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 20:12:19,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 20:12:19,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 20:12:19,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:19,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:12:19,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:12:19,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:12:19,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 20:12:19,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:19,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:12:19,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:12:19,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:12:19,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,34071,1689970216065': 2023-07-21 20:12:19,658 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34071,1689970216065' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-21 20:12:19,658 INFO [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-21 20:12:19,658 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-21 20:12:19,658 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-21 20:12:19,658 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:19,658 INFO [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-21 20:12:19,660 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:19,660 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:19,661 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:19,661 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:19,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:19,661 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:19,661 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:12:19,661 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:19,661 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:12:19,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:19,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 20:12:19,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 20:12:19,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:19,661 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:19,661 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:12:19,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:12:19,661 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:12:19,661 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:12:19,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:19,661 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:12:19,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:12:19,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:19,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 20:12:19,663 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:12:19,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:12:19,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:19,663 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:12:19,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:19,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:19,664 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:12:19,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 20:12:19,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:19,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:12:19,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:12:19,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:12:19,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 20:12:19,666 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:12:19,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:19,667 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:12:19,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:12:19,667 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:12:19,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:12:19,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:12:19,672 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:12:19,672 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:12:19,672 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:12:19,673 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:12:19,673 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:12:19,673 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:12:19,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:12:19,673 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:12:19,672 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:12:19,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:12:19,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:12:19,673 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:12:19,673 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:12:19,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:12:19,673 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:12:19,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:12:19,673 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:12:19,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:12:19,678 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:12:19,678 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:19,679 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:12:19,679 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:12:19,679 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 20:12:19,679 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:19,679 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:19,679 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:12:19,681 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:19,681 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:19,681 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:12:19,681 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:19,681 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:12:19,681 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-21 20:12:19,681 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:19,681 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:19,682 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-21 20:12:19,696 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:19,697 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:19,715 DEBUG [Listener at jenkins-hbase4.apache.org/38105] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 20:12:19,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-21 20:12:19,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-21 20:12:19,716 DEBUG [Listener at jenkins-hbase4.apache.org/38105] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-21 20:12:19,740 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:20,017 DEBUG [Listener at jenkins-hbase4.apache.org/38105] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 20:12:20,018 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-21 20:12:20,018 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-21 20:12:20,018 DEBUG [Listener at jenkins-hbase4.apache.org/38105] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-21 20:12:20,210 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-21 20:12:20,210 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:20,211 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:20,211 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689970339410Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1689970339696 (+286 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689970339696Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689970339696Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689970339701 (+5 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689970339733 (+32 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689970340210 (+477 ms) 2023-07-21 20:12:20,214 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-21 20:12:20,216 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 803 msec 2023-07-21 20:12:20,518 DEBUG [Listener at jenkins-hbase4.apache.org/38105] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 20:12:20,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-21 20:12:20,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-21 20:12:20,528 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1689970338708.af48fddb17722592770c99949e6c1521. with WAL disabled. Data may be lost in the event of a crash. 2023-07-21 20:12:20,529 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34071] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1689970338708.312a6ccf56bb15fc405ce942794e813d. with WAL disabled. Data may be lost in the event of a crash. 2023-07-21 20:12:20,537 DEBUG [Listener at jenkins-hbase4.apache.org/38105] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:20,537 DEBUG [Listener at jenkins-hbase4.apache.org/38105] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1689970338708.af48fddb17722592770c99949e6c1521. 2023-07-21 20:12:20,537 INFO [Listener at jenkins-hbase4.apache.org/38105] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-21 20:12:20,551 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-21 20:12:20,551 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689970340551 (current time:1689970340551). 2023-07-21 20:12:20,552 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-21 20:12:20,552 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] zookeeper.ReadOnlyZKClient(139): Connect 0x7dd2deba to 127.0.0.1:59101 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 20:12:20,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4e6be3be, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 20:12:20,588 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 20:12:20,589 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43694, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 20:12:20,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7dd2deba to 127.0.0.1:59101 2023-07-21 20:12:20,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 20:12:20,592 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] zookeeper.ReadOnlyZKClient(139): Connect 0x7c5aef22 to 127.0.0.1:59101 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 20:12:20,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1796d91d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 20:12:20,611 DEBUG [hconnection-0x671be42-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 20:12:20,616 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43704, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 20:12:20,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 20:12:20,625 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37326, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 20:12:20,631 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7c5aef22 to 127.0.0.1:59101 2023-07-21 20:12:20,631 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 20:12:20,631 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-21 20:12:20,632 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-21 20:12:20,632 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-21 20:12:20,634 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-21 20:12:20,636 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-21 20:12:20,637 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689970940637 2023-07-21 20:12:20,637 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-21 20:12:20,637 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:20,639 DEBUG [Listener at jenkins-hbase4.apache.org/38105] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-21 20:12:20,639 DEBUG [Listener at jenkins-hbase4.apache.org/38105] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-21 20:12:20,643 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-21 20:12:20,644 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-21 20:12:20,647 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 10 msec 2023-07-21 20:12:20,648 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-21 20:12:20,649 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689970940649 2023-07-21 20:12:20,694 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:20,694 INFO [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-21 20:12:20,694 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 20:12:20,697 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-21 20:12:20,697 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-21 20:12:20,701 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:20,701 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:20,703 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:12:20,703 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:12:20,703 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:12:20,703 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:12:20,703 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:12:20,703 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:12:20,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:12:20,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:12:20,703 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:12:20,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:12:20,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:20,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:20,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:20,704 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:20,704 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:20,704 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:12:20,704 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:12:20,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-21 20:12:20,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-21 20:12:20,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:20,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:20,705 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-21 20:12:20,704 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:20,705 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-21 20:12:20,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-21 20:12:20,705 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:12:20,705 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-21 20:12:20,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:20,706 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-21 20:12:20,708 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:20,708 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-21 20:12:20,708 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 20:12:20,716 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:20,716 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-21 20:12:20,717 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 20:12:20,717 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:20,718 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-21 20:12:20,723 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-21 20:12:20,723 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34071,1689970216065' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-21 20:12:20,718 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-21 20:12:20,723 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-21 20:12:20,724 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37823,1689970216018' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-21 20:12:20,725 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:20,725 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:12:20,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:12:20,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 20:12:20,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 20:12:20,726 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-21 20:12:20,726 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 20:12:20,728 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-21 20:12:20,728 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-21 20:12:20,728 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40099,1689970215928' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-21 20:12:20,735 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:20,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 20:12:20,735 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:20,735 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 20:12:20,735 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:20,735 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 20:12:20,736 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:20,737 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:12:20,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 20:12:20,737 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:20,737 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 20:12:20,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:20,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:12:20,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:12:20,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:12:20,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 20:12:20,739 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34071,1689970216065' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-21 20:12:20,739 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4dc9d531[Count = 1] remaining members to acquire global barrier 2023-07-21 20:12:20,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:12:20,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 20:12:20,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 20:12:20,739 DEBUG [Listener at jenkins-hbase4.apache.org/38105] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 20:12:20,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 20:12:20,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 20:12:20,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-21 20:12:20,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-21 20:12:20,741 DEBUG [Listener at jenkins-hbase4.apache.org/38105] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-21 20:12:20,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:20,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:12:20,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:12:20,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:12:20,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 20:12:20,743 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40099,1689970215928' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-21 20:12:20,743 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4dc9d531[Count = 0] remaining members to acquire global barrier 2023-07-21 20:12:20,743 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-21 20:12:20,743 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:20,747 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:20,747 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:20,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:20,748 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-21 20:12:20,747 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:20,747 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:20,748 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:20,748 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:20,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:20,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:20,748 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-21 20:12:20,748 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-21 20:12:20,748 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-21 20:12:20,748 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,37823,1689970216018' in zk 2023-07-21 20:12:20,749 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:12:20,750 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:12:20,750 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-21 20:12:20,751 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 20:12:20,751 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 20:12:20,751 DEBUG [rs(jenkins-hbase4.apache.org,34071,1689970216065)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689970338708.312a6ccf56bb15fc405ce942794e813d. 2023-07-21 20:12:20,752 DEBUG [rs(jenkins-hbase4.apache.org,34071,1689970216065)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689970338708.312a6ccf56bb15fc405ce942794e813d. started... 2023-07-21 20:12:20,752 INFO [rs(jenkins-hbase4.apache.org,34071,1689970216065)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 312a6ccf56bb15fc405ce942794e813d 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-21 20:12:20,752 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-21 20:12:20,752 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 20:12:20,752 DEBUG [member: 'jenkins-hbase4.apache.org,37823,1689970216018' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-21 20:12:20,753 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 20:12:20,753 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 20:12:20,761 DEBUG [rs(jenkins-hbase4.apache.org,40099,1689970215928)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689970338708.af48fddb17722592770c99949e6c1521. 2023-07-21 20:12:20,762 DEBUG [rs(jenkins-hbase4.apache.org,40099,1689970215928)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689970338708.af48fddb17722592770c99949e6c1521. started... 2023-07-21 20:12:20,762 INFO [rs(jenkins-hbase4.apache.org,40099,1689970215928)-snapshot-pool-0] regionserver.HRegion(2745): Flushing af48fddb17722592770c99949e6c1521 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-21 20:12:20,824 INFO [rs(jenkins-hbase4.apache.org,40099,1689970215928)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307215f0746a4edfe4e7bb660338889019906 to hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202307215f0746a4edfe4e7bb660338889019906 2023-07-21 20:12:20,824 INFO [rs(jenkins-hbase4.apache.org,34071,1689970216065)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023072191651e9d2e534bf98756cce3de9bfa4e to hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b2023072191651e9d2e534bf98756cce3de9bfa4e 2023-07-21 20:12:20,883 INFO [rs(jenkins-hbase4.apache.org,34071,1689970216065)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testExportFileSystemStateWithSkipTmp/312a6ccf56bb15fc405ce942794e813d/.tmp/cf/58bbf36537c4458d9072fe3de54053a6 2023-07-21 20:12:20,894 DEBUG [rs(jenkins-hbase4.apache.org,34071,1689970216065)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testExportFileSystemStateWithSkipTmp/312a6ccf56bb15fc405ce942794e813d/.tmp/cf/58bbf36537c4458d9072fe3de54053a6 as hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testExportFileSystemStateWithSkipTmp/312a6ccf56bb15fc405ce942794e813d/cf/58bbf36537c4458d9072fe3de54053a6 2023-07-21 20:12:20,900 INFO [rs(jenkins-hbase4.apache.org,34071,1689970216065)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testExportFileSystemStateWithSkipTmp/312a6ccf56bb15fc405ce942794e813d/cf/58bbf36537c4458d9072fe3de54053a6, entries=47, sequenceid=6, filesize=13.3 K 2023-07-21 20:12:20,908 INFO [rs(jenkins-hbase4.apache.org,34071,1689970216065)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 312a6ccf56bb15fc405ce942794e813d in 156ms, sequenceid=6, compaction requested=false 2023-07-21 20:12:20,908 DEBUG [rs(jenkins-hbase4.apache.org,34071,1689970216065)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-07-21 20:12:20,909 DEBUG [rs(jenkins-hbase4.apache.org,34071,1689970216065)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 312a6ccf56bb15fc405ce942794e813d: 2023-07-21 20:12:20,909 DEBUG [rs(jenkins-hbase4.apache.org,34071,1689970216065)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689970338708.312a6ccf56bb15fc405ce942794e813d.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:20,909 DEBUG [rs(jenkins-hbase4.apache.org,34071,1689970216065)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 20:12:20,909 DEBUG [rs(jenkins-hbase4.apache.org,34071,1689970216065)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testExportFileSystemStateWithSkipTmp/312a6ccf56bb15fc405ce942794e813d/cf/58bbf36537c4458d9072fe3de54053a6] hfiles 2023-07-21 20:12:20,909 DEBUG [rs(jenkins-hbase4.apache.org,34071,1689970216065)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testExportFileSystemStateWithSkipTmp/312a6ccf56bb15fc405ce942794e813d/cf/58bbf36537c4458d9072fe3de54053a6 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:20,930 INFO [rs(jenkins-hbase4.apache.org,40099,1689970215928)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testExportFileSystemStateWithSkipTmp/af48fddb17722592770c99949e6c1521/.tmp/cf/370e6cebb5d4413f8d11393fbe888ccb 2023-07-21 20:12:20,941 DEBUG [Listener at jenkins-hbase4.apache.org/38105] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 20:12:20,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-21 20:12:20,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-21 20:12:20,942 DEBUG [Listener at jenkins-hbase4.apache.org/38105] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-21 20:12:20,970 DEBUG [rs(jenkins-hbase4.apache.org,40099,1689970215928)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testExportFileSystemStateWithSkipTmp/af48fddb17722592770c99949e6c1521/.tmp/cf/370e6cebb5d4413f8d11393fbe888ccb as hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testExportFileSystemStateWithSkipTmp/af48fddb17722592770c99949e6c1521/cf/370e6cebb5d4413f8d11393fbe888ccb 2023-07-21 20:12:20,973 DEBUG [rs(jenkins-hbase4.apache.org,34071,1689970216065)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689970338708.312a6ccf56bb15fc405ce942794e813d. completed. 2023-07-21 20:12:20,973 DEBUG [rs(jenkins-hbase4.apache.org,34071,1689970216065)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689970338708.312a6ccf56bb15fc405ce942794e813d. 2023-07-21 20:12:20,973 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 20:12:20,973 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 20:12:20,973 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:12:20,973 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-21 20:12:20,973 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,34071,1689970216065' in zk 2023-07-21 20:12:20,975 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:12:20,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:12:20,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 20:12:20,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 20:12:20,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 20:12:20,979 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-21 20:12:20,979 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 20:12:20,979 DEBUG [member: 'jenkins-hbase4.apache.org,34071,1689970216065' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-21 20:12:20,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 20:12:20,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:20,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:12:20,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:12:20,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:12:20,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 20:12:20,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:20,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:12:20,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:12:20,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,34071,1689970216065': 2023-07-21 20:12:20,987 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34071,1689970216065' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-21 20:12:20,987 INFO [rs(jenkins-hbase4.apache.org,40099,1689970215928)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testExportFileSystemStateWithSkipTmp/af48fddb17722592770c99949e6c1521/cf/370e6cebb5d4413f8d11393fbe888ccb, entries=3, sequenceid=6, filesize=5.4 K 2023-07-21 20:12:20,988 INFO [rs(jenkins-hbase4.apache.org,40099,1689970215928)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for af48fddb17722592770c99949e6c1521 in 226ms, sequenceid=6, compaction requested=false 2023-07-21 20:12:20,990 DEBUG [rs(jenkins-hbase4.apache.org,40099,1689970215928)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for af48fddb17722592770c99949e6c1521: 2023-07-21 20:12:20,990 DEBUG [rs(jenkins-hbase4.apache.org,40099,1689970215928)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689970338708.af48fddb17722592770c99949e6c1521.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:20,990 DEBUG [rs(jenkins-hbase4.apache.org,40099,1689970215928)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 20:12:20,990 DEBUG [rs(jenkins-hbase4.apache.org,40099,1689970215928)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testExportFileSystemStateWithSkipTmp/af48fddb17722592770c99949e6c1521/cf/370e6cebb5d4413f8d11393fbe888ccb] hfiles 2023-07-21 20:12:20,990 DEBUG [rs(jenkins-hbase4.apache.org,40099,1689970215928)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testExportFileSystemStateWithSkipTmp/af48fddb17722592770c99949e6c1521/cf/370e6cebb5d4413f8d11393fbe888ccb for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:21,050 DEBUG [rs(jenkins-hbase4.apache.org,40099,1689970215928)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689970338708.af48fddb17722592770c99949e6c1521. completed. 2023-07-21 20:12:21,050 DEBUG [rs(jenkins-hbase4.apache.org,40099,1689970215928)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689970338708.af48fddb17722592770c99949e6c1521. 2023-07-21 20:12:21,050 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 20:12:21,050 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 20:12:21,050 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:12:21,050 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-21 20:12:21,050 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,40099,1689970215928' in zk 2023-07-21 20:12:21,052 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:12:21,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:12:21,052 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-21 20:12:21,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 20:12:21,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 20:12:21,053 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 20:12:21,053 DEBUG [member: 'jenkins-hbase4.apache.org,40099,1689970215928' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-21 20:12:21,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 20:12:21,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 20:12:21,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:21,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:12:21,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:12:21,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:12:21,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 20:12:21,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:21,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:12:21,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:12:21,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:12:21,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,40099,1689970215928': 2023-07-21 20:12:21,062 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40099,1689970215928' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-21 20:12:21,062 INFO [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-21 20:12:21,062 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-21 20:12:21,062 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-21 20:12:21,062 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:21,062 INFO [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-21 20:12:21,064 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:21,064 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:21,064 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:21,064 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:21,064 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:21,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:21,064 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:21,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:21,064 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:12:21,064 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:12:21,064 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:21,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:21,064 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:12:21,065 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:12:21,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:21,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 20:12:21,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 20:12:21,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:12:21,066 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:12:21,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 20:12:21,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:12:21,066 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:12:21,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:21,067 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:12:21,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:12:21,067 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:12:21,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:21,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:21,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:21,071 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:12:21,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 20:12:21,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:21,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:12:21,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:12:21,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:12:21,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 20:12:21,076 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:12:21,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:21,077 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:12:21,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:12:21,078 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:12:21,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:12:21,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:12:21,084 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:12:21,084 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:21,084 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:12:21,084 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:12:21,084 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:12:21,084 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:12:21,084 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:12:21,084 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:12:21,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:12:21,084 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:12:21,085 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:12:21,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:12:21,085 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:12:21,085 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:12:21,084 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:21,085 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:12:21,086 DEBUG [(jenkins-hbase4.apache.org,41777,1689970214362)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 20:12:21,084 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:12:21,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:12:21,086 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:21,088 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:21,088 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:21,088 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-21 20:12:21,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:12:21,086 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:12:21,089 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:21,089 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:12:21,089 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:12:21,089 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:21,089 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:21,089 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:12:21,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:12:21,089 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:12:21,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:12:21,089 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b2023072191651e9d2e534bf98756cce3de9bfa4e, hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202307215f0746a4edfe4e7bb660338889019906] mob files 2023-07-21 20:12:21,089 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b2023072191651e9d2e534bf98756cce3de9bfa4e 2023-07-21 20:12:21,089 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202307215f0746a4edfe4e7bb660338889019906 2023-07-21 20:12:21,138 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:21,139 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:21,226 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:21,243 DEBUG [Listener at jenkins-hbase4.apache.org/38105] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 20:12:21,248 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-21 20:12:21,248 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-21 20:12:21,249 DEBUG [Listener at jenkins-hbase4.apache.org/38105] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-21 20:12:21,297 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-21 20:12:21,297 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:21,297 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:21,297 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689970340637Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1689970341138 (+501 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689970341138Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1689970341138Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1689970341167 (+29 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689970341216 (+49 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689970341297 (+81 ms) 2023-07-21 20:12:21,301 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-21 20:12:21,303 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 662 msec 2023-07-21 20:12:21,749 DEBUG [Listener at jenkins-hbase4.apache.org/38105] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 20:12:21,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-21 20:12:21,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-21 20:12:21,751 INFO [Listener at jenkins-hbase4.apache.org/38105] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/export-test/export-1689970341751 2023-07-21 20:12:21,751 INFO [Listener at jenkins-hbase4.apache.org/38105] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:40641, tgtDir=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/export-test/export-1689970341751, rawTgtDir=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/export-test/export-1689970341751, srcFsUri=hdfs://localhost:40641, srcDir=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00 2023-07-21 20:12:21,784 DEBUG [Listener at jenkins-hbase4.apache.org/38105] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:40641, inputRoot=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00 2023-07-21 20:12:21,784 DEBUG [Listener at jenkins-hbase4.apache.org/38105] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-43259962_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/export-test/export-1689970341751, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/export-test/export-1689970341751/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:21,784 INFO [Listener at jenkins-hbase4.apache.org/38105] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:40641, inputRoot=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00, snapshotDir=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-07-21 20:12:21,809 INFO [Listener at jenkins-hbase4.apache.org/38105] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/export-test/export-1689970341751/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:21,936 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-21 20:12:21,937 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-21 20:12:21,937 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-21 20:12:21,938 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-21 20:12:22,712 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689970225203_0006_000001 (auth:SIMPLE) 2023-07-21 20:12:23,230 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c4475fbf-6a12-c189-d7a2-889953ef4b74/hadoop-8340043456089247092.jar 2023-07-21 20:12:23,231 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-21 20:12:23,232 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-21 20:12:23,352 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c4475fbf-6a12-c189-d7a2-889953ef4b74/hadoop-4764514698098164807.jar 2023-07-21 20:12:23,353 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-21 20:12:23,354 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-21 20:12:23,358 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-21 20:12:23,358 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-21 20:12:23,359 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-21 20:12:23,359 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-21 20:12:23,360 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-21 20:12:23,360 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-21 20:12:23,361 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-21 20:12:23,362 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-21 20:12:23,362 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-21 20:12:23,363 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-21 20:12:23,363 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-21 20:12:23,364 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-21 20:12:23,364 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-21 20:12:23,365 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-21 20:12:23,366 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 20:12:23,367 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 20:12:23,367 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-21 20:12:23,368 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 20:12:23,368 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 20:12:23,369 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-21 20:12:23,370 DEBUG [Listener at jenkins-hbase4.apache.org/38105] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-21 20:12:24,007 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-21 20:12:25,153 WARN [Listener at jenkins-hbase4.apache.org/38105] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-21 20:12:25,156 INFO [Listener at jenkins-hbase4.apache.org/38105] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-07-21 20:12:25,159 DEBUG [Listener at jenkins-hbase4.apache.org/38105] snapshot.ExportSnapshot(671): export split=0 size=31.5 K 2023-07-21 20:12:25,283 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-21 20:12:25,284 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-21 20:12:25,409 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689970225203_0007_000001 (auth:SIMPLE) 2023-07-21 20:12:31,284 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689970225203_0007_000001 (auth:SIMPLE) 2023-07-21 20:12:33,623 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689970225203_0007_000001 (auth:SIMPLE) 2023-07-21 20:12:36,978 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689970225203_0007_000001 (auth:SIMPLE) 2023-07-21 20:12:38,597 INFO [Listener at jenkins-hbase4.apache.org/38105] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-21 20:12:38,597 INFO [Listener at jenkins-hbase4.apache.org/38105] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-21 20:12:38,607 INFO [Listener at jenkins-hbase4.apache.org/38105] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:38,607 INFO [Listener at jenkins-hbase4.apache.org/38105] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-21 20:12:38,607 INFO [Listener at jenkins-hbase4.apache.org/38105] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-21 20:12:38,607 DEBUG [Listener at jenkins-hbase4.apache.org/38105] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_895530006_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:38,608 DEBUG [Listener at jenkins-hbase4.apache.org/38105] snapshot.TestExportSnapshot(367): hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-21 20:12:38,608 DEBUG [Listener at jenkins-hbase4.apache.org/38105] snapshot.TestExportSnapshot(367): hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-21 20:12:38,608 DEBUG [Listener at jenkins-hbase4.apache.org/38105] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_895530006_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/export-test/export-1689970341751/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/export-test/export-1689970341751/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:38,608 DEBUG [Listener at jenkins-hbase4.apache.org/38105] snapshot.TestExportSnapshot(367): hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/export-test/export-1689970341751/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-21 20:12:38,608 DEBUG [Listener at jenkins-hbase4.apache.org/38105] snapshot.TestExportSnapshot(367): hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/export-test/export-1689970341751/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-21 20:12:38,614 INFO [Listener at jenkins-hbase4.apache.org/38105] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:38,615 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:38,615 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] procedure2.ProcedureExecutor(1029): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:38,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-21 20:12:38,618 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689970358618"}]},"ts":"1689970358618"} 2023-07-21 20:12:38,619 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-07-21 20:12:38,621 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-07-21 20:12:38,622 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=af48fddb17722592770c99949e6c1521, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=312a6ccf56bb15fc405ce942794e813d, UNASSIGN}] 2023-07-21 20:12:38,623 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=af48fddb17722592770c99949e6c1521, UNASSIGN 2023-07-21 20:12:38,623 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=312a6ccf56bb15fc405ce942794e813d, UNASSIGN 2023-07-21 20:12:38,624 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=af48fddb17722592770c99949e6c1521, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:12:38,624 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=312a6ccf56bb15fc405ce942794e813d, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:12:38,624 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689970338708.af48fddb17722592770c99949e6c1521.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689970358624"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689970358624"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689970358624"}]},"ts":"1689970358624"} 2023-07-21 20:12:38,624 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689970338708.312a6ccf56bb15fc405ce942794e813d.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689970358624"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689970358624"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689970358624"}]},"ts":"1689970358624"} 2023-07-21 20:12:38,625 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=115, state=RUNNABLE; CloseRegionProcedure af48fddb17722592770c99949e6c1521, server=jenkins-hbase4.apache.org,40099,1689970215928}] 2023-07-21 20:12:38,626 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=118, ppid=116, state=RUNNABLE; CloseRegionProcedure 312a6ccf56bb15fc405ce942794e813d, server=jenkins-hbase4.apache.org,34071,1689970216065}] 2023-07-21 20:12:38,719 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-21 20:12:38,777 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close af48fddb17722592770c99949e6c1521 2023-07-21 20:12:38,777 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing af48fddb17722592770c99949e6c1521, disabling compactions & flushes 2023-07-21 20:12:38,777 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689970338708.af48fddb17722592770c99949e6c1521. 2023-07-21 20:12:38,777 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689970338708.af48fddb17722592770c99949e6c1521. 2023-07-21 20:12:38,777 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689970338708.af48fddb17722592770c99949e6c1521. after waiting 0 ms 2023-07-21 20:12:38,777 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689970338708.af48fddb17722592770c99949e6c1521. 2023-07-21 20:12:38,781 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 312a6ccf56bb15fc405ce942794e813d 2023-07-21 20:12:38,781 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 312a6ccf56bb15fc405ce942794e813d, disabling compactions & flushes 2023-07-21 20:12:38,781 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689970338708.312a6ccf56bb15fc405ce942794e813d. 2023-07-21 20:12:38,781 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689970338708.312a6ccf56bb15fc405ce942794e813d. 2023-07-21 20:12:38,781 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689970338708.312a6ccf56bb15fc405ce942794e813d. after waiting 0 ms 2023-07-21 20:12:38,781 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689970338708.312a6ccf56bb15fc405ce942794e813d. 2023-07-21 20:12:38,792 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testExportFileSystemStateWithSkipTmp/af48fddb17722592770c99949e6c1521/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-21 20:12:38,792 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/default/testtb-testExportFileSystemStateWithSkipTmp/312a6ccf56bb15fc405ce942794e813d/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-21 20:12:38,792 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 20:12:38,793 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689970338708.af48fddb17722592770c99949e6c1521. 2023-07-21 20:12:38,793 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for af48fddb17722592770c99949e6c1521: 2023-07-21 20:12:38,794 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 20:12:38,794 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689970338708.312a6ccf56bb15fc405ce942794e813d. 2023-07-21 20:12:38,794 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 312a6ccf56bb15fc405ce942794e813d: 2023-07-21 20:12:38,795 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed af48fddb17722592770c99949e6c1521 2023-07-21 20:12:38,796 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=af48fddb17722592770c99949e6c1521, regionState=CLOSED 2023-07-21 20:12:38,796 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 312a6ccf56bb15fc405ce942794e813d 2023-07-21 20:12:38,796 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689970338708.af48fddb17722592770c99949e6c1521.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689970358796"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689970358796"}]},"ts":"1689970358796"} 2023-07-21 20:12:38,796 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=312a6ccf56bb15fc405ce942794e813d, regionState=CLOSED 2023-07-21 20:12:38,796 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689970338708.312a6ccf56bb15fc405ce942794e813d.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689970358796"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689970358796"}]},"ts":"1689970358796"} 2023-07-21 20:12:38,799 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=117, resume processing ppid=115 2023-07-21 20:12:38,799 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=115, state=SUCCESS; CloseRegionProcedure af48fddb17722592770c99949e6c1521, server=jenkins-hbase4.apache.org,40099,1689970215928 in 172 msec 2023-07-21 20:12:38,799 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=118, resume processing ppid=116 2023-07-21 20:12:38,799 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=116, state=SUCCESS; CloseRegionProcedure 312a6ccf56bb15fc405ce942794e813d, server=jenkins-hbase4.apache.org,34071,1689970216065 in 172 msec 2023-07-21 20:12:38,800 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=af48fddb17722592770c99949e6c1521, UNASSIGN in 178 msec 2023-07-21 20:12:38,801 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=116, resume processing ppid=114 2023-07-21 20:12:38,801 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=312a6ccf56bb15fc405ce942794e813d, UNASSIGN in 178 msec 2023-07-21 20:12:38,802 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689970358801"}]},"ts":"1689970358801"} 2023-07-21 20:12:38,803 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-07-21 20:12:38,810 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-07-21 20:12:38,813 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 196 msec 2023-07-21 20:12:38,920 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-21 20:12:38,920 INFO [Listener at jenkins-hbase4.apache.org/38105] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-07-21 20:12:38,921 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:38,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] procedure2.ProcedureExecutor(1029): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:38,924 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:38,924 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:38,925 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:38,926 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37823] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:38,928 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:38,928 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:38,929 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/af48fddb17722592770c99949e6c1521 2023-07-21 20:12:38,929 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:38,928 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:38,929 DEBUG [HFileArchiver-23] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/312a6ccf56bb15fc405ce942794e813d 2023-07-21 20:12:38,929 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-21 20:12:38,929 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-21 20:12:38,930 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:38,930 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:38,930 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 20:12:38,930 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 20:12:38,930 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data null 2023-07-21 20:12:38,930 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 20:12:38,930 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-21 20:12:38,931 DEBUG [HFileArchiver-22] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/af48fddb17722592770c99949e6c1521/cf, FileablePath, hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/af48fddb17722592770c99949e6c1521/recovered.edits] 2023-07-21 20:12:38,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-21 20:12:38,931 DEBUG [HFileArchiver-23] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/312a6ccf56bb15fc405ce942794e813d/cf, FileablePath, hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/312a6ccf56bb15fc405ce942794e813d/recovered.edits] 2023-07-21 20:12:38,935 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/af48fddb17722592770c99949e6c1521/cf/370e6cebb5d4413f8d11393fbe888ccb to hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/af48fddb17722592770c99949e6c1521/cf/370e6cebb5d4413f8d11393fbe888ccb 2023-07-21 20:12:38,935 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/312a6ccf56bb15fc405ce942794e813d/cf/58bbf36537c4458d9072fe3de54053a6 to hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/312a6ccf56bb15fc405ce942794e813d/cf/58bbf36537c4458d9072fe3de54053a6 2023-07-21 20:12:38,938 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 20:12:38,938 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data null 2023-07-21 20:12:38,939 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-21 20:12:38,939 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/312a6ccf56bb15fc405ce942794e813d/recovered.edits/9.seqid to hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/312a6ccf56bb15fc405ce942794e813d/recovered.edits/9.seqid 2023-07-21 20:12:38,940 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/af48fddb17722592770c99949e6c1521/recovered.edits/9.seqid to hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/af48fddb17722592770c99949e6c1521/recovered.edits/9.seqid 2023-07-21 20:12:38,940 DEBUG [HFileArchiver-23] backup.HFileArchiver(596): Deleted hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/312a6ccf56bb15fc405ce942794e813d 2023-07-21 20:12:38,941 DEBUG [HFileArchiver-22] backup.HFileArchiver(596): Deleted hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/af48fddb17722592770c99949e6c1521 2023-07-21 20:12:38,941 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-21 20:12:38,941 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-07-21 20:12:38,942 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf] 2023-07-21 20:12:38,945 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b2023072191651e9d2e534bf98756cce3de9bfa4e to hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b2023072191651e9d2e534bf98756cce3de9bfa4e 2023-07-21 20:12:38,946 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202307215f0746a4edfe4e7bb660338889019906 to hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202307215f0746a4edfe4e7bb660338889019906 2023-07-21 20:12:38,946 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-07-21 20:12:38,948 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:38,949 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-07-21 20:12:38,951 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-07-21 20:12:38,952 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:38,952 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-07-21 20:12:38,952 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689970338708.af48fddb17722592770c99949e6c1521.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689970358952"}]},"ts":"9223372036854775807"} 2023-07-21 20:12:38,952 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689970338708.312a6ccf56bb15fc405ce942794e813d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689970358952"}]},"ts":"9223372036854775807"} 2023-07-21 20:12:38,954 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-21 20:12:38,954 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => af48fddb17722592770c99949e6c1521, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689970338708.af48fddb17722592770c99949e6c1521.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 312a6ccf56bb15fc405ce942794e813d, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689970338708.312a6ccf56bb15fc405ce942794e813d.', STARTKEY => '1', ENDKEY => ''}] 2023-07-21 20:12:38,954 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-07-21 20:12:38,954 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689970358954"}]},"ts":"9223372036854775807"} 2023-07-21 20:12:38,955 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-07-21 20:12:38,959 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:38,960 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 38 msec 2023-07-21 20:12:39,032 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-21 20:12:39,033 INFO [Listener at jenkins-hbase4.apache.org/38105] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-07-21 20:12:39,043 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-21 20:12:39,045 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:39,046 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-21 20:12:39,048 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41777] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:39,081 INFO [Listener at jenkins-hbase4.apache.org/38105] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=762 (was 764), OpenFileDescriptor=902 (was 923), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=505 (was 462) - SystemLoadAverage LEAK? -, ProcessCount=182 (was 184), AvailableMemoryMB=5854 (was 6750) 2023-07-21 20:12:39,081 WARN [Listener at jenkins-hbase4.apache.org/38105] hbase.ResourceChecker(130): Thread=762 is superior to 500 2023-07-21 20:12:39,081 INFO [Listener at jenkins-hbase4.apache.org/38105] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-07-21 20:12:39,097 INFO [Listener at jenkins-hbase4.apache.org/38105] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-21 20:12:39,209 WARN [ContainersLauncher #0] nodemanager.DefaultContainerExecutor(305): Exit code from container container_1689970225203_0007_01_000001 is : 143 2023-07-21 20:12:44,373 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-21 20:12:53,232 INFO [Listener at jenkins-hbase4.apache.org/38105] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-21 20:13:07,354 ERROR [Thread[Thread-410,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-21 20:13:07,355 INFO [Listener at jenkins-hbase4.apache.org/38105] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-21 20:13:07,466 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-07-21 20:13:07,477 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-07-21 20:13:07,479 ERROR [Thread[Thread-420,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-21 20:13:07,494 INFO [Listener at jenkins-hbase4.apache.org/38105] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-21 20:13:07,602 ERROR [Thread[Thread-384,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-21 20:13:07,602 INFO [Listener at jenkins-hbase4.apache.org/38105] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-07-21 20:13:07,602 INFO [Listener at jenkins-hbase4.apache.org/38105] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-21 20:13:07,602 INFO [Listener at jenkins-hbase4.apache.org/38105] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-21 20:13:07,602 DEBUG [Listener at jenkins-hbase4.apache.org/38105] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x783bbc0f to 127.0.0.1:59101 2023-07-21 20:13:07,602 DEBUG [Listener at jenkins-hbase4.apache.org/38105] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 20:13:07,603 DEBUG [Listener at jenkins-hbase4.apache.org/38105] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-21 20:13:07,603 DEBUG [Listener at jenkins-hbase4.apache.org/38105] util.JVMClusterUtil(257): Found active master hash=290818262, stopped=false 2023-07-21 20:13:07,604 DEBUG [Listener at jenkins-hbase4.apache.org/38105] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 20:13:07,604 DEBUG [Listener at jenkins-hbase4.apache.org/38105] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-21 20:13:07,604 INFO [Listener at jenkins-hbase4.apache.org/38105] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,41777,1689970214362 2023-07-21 20:13:07,605 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-21 20:13:07,605 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-21 20:13:07,605 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-21 20:13:07,606 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-21 20:13:07,606 INFO [Listener at jenkins-hbase4.apache.org/38105] procedure2.ProcedureExecutor(629): Stopping 2023-07-21 20:13:07,606 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-21 20:13:07,606 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-21 20:13:07,606 DEBUG [Listener at jenkins-hbase4.apache.org/38105] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x049d6ab6 to 127.0.0.1:59101 2023-07-21 20:13:07,606 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-21 20:13:07,606 DEBUG [Listener at jenkins-hbase4.apache.org/38105] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 20:13:07,606 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-21 20:13:07,606 INFO [Listener at jenkins-hbase4.apache.org/38105] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,40099,1689970215928' ***** 2023-07-21 20:13:07,607 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-21 20:13:07,607 DEBUG [Listener at jenkins-hbase4.apache.org/38105] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 20:13:07,607 INFO [Listener at jenkins-hbase4.apache.org/38105] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-21 20:13:07,607 INFO [Listener at jenkins-hbase4.apache.org/38105] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,37823,1689970216018' ***** 2023-07-21 20:13:07,607 INFO [RS:0;jenkins-hbase4:40099] regionserver.HeapMemoryManager(220): Stopping 2023-07-21 20:13:07,607 DEBUG [Listener at jenkins-hbase4.apache.org/38105] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 20:13:07,608 INFO [Listener at jenkins-hbase4.apache.org/38105] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-21 20:13:07,608 INFO [RS:0;jenkins-hbase4:40099] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-21 20:13:07,608 INFO [Listener at jenkins-hbase4.apache.org/38105] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,34071,1689970216065' ***** 2023-07-21 20:13:07,608 INFO [RS:0;jenkins-hbase4:40099] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-21 20:13:07,608 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-21 20:13:07,608 DEBUG [Listener at jenkins-hbase4.apache.org/38105] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 20:13:07,608 INFO [RS:1;jenkins-hbase4:37823] regionserver.HeapMemoryManager(220): Stopping 2023-07-21 20:13:07,608 INFO [RS:0;jenkins-hbase4:40099] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:13:07,608 INFO [Listener at jenkins-hbase4.apache.org/38105] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-21 20:13:07,608 DEBUG [RS:0;jenkins-hbase4:40099] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x666c3de0 to 127.0.0.1:59101 2023-07-21 20:13:07,608 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-21 20:13:07,608 INFO [RS:1;jenkins-hbase4:37823] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-21 20:13:07,608 INFO [RS:1;jenkins-hbase4:37823] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-21 20:13:07,608 INFO [RS:2;jenkins-hbase4:34071] regionserver.HeapMemoryManager(220): Stopping 2023-07-21 20:13:07,608 DEBUG [RS:0;jenkins-hbase4:40099] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 20:13:07,609 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-21 20:13:07,609 INFO [RS:2;jenkins-hbase4:34071] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-21 20:13:07,609 INFO [RS:1;jenkins-hbase4:37823] regionserver.HRegionServer(3305): Received CLOSE for 1b3082bcd4e87c68447f85e5143e2878 2023-07-21 20:13:07,611 INFO [RS:0;jenkins-hbase4:40099] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-21 20:13:07,612 INFO [RS:0;jenkins-hbase4:40099] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-21 20:13:07,612 INFO [RS:0;jenkins-hbase4:40099] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-21 20:13:07,611 INFO [RS:2;jenkins-hbase4:34071] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-21 20:13:07,612 INFO [RS:0;jenkins-hbase4:40099] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-21 20:13:07,612 INFO [RS:1;jenkins-hbase4:37823] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:13:07,612 DEBUG [RS:1;jenkins-hbase4:37823] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x00fdec25 to 127.0.0.1:59101 2023-07-21 20:13:07,612 DEBUG [RS:1;jenkins-hbase4:37823] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 20:13:07,612 INFO [RS:2;jenkins-hbase4:34071] regionserver.HRegionServer(3305): Received CLOSE for 3c6f124cc5357f8acdaf270484dac43a 2023-07-21 20:13:07,612 INFO [RS:2;jenkins-hbase4:34071] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:13:07,612 DEBUG [RS:2;jenkins-hbase4:34071] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x20ad8ddf to 127.0.0.1:59101 2023-07-21 20:13:07,612 DEBUG [RS:2;jenkins-hbase4:34071] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 20:13:07,615 INFO [RS:0;jenkins-hbase4:40099] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-21 20:13:07,616 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 3c6f124cc5357f8acdaf270484dac43a, disabling compactions & flushes 2023-07-21 20:13:07,616 DEBUG [RS:0;jenkins-hbase4:40099] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-07-21 20:13:07,617 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689970218998.3c6f124cc5357f8acdaf270484dac43a. 2023-07-21 20:13:07,616 INFO [RS:1;jenkins-hbase4:37823] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-21 20:13:07,616 INFO [RS:2;jenkins-hbase4:34071] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-21 20:13:07,617 DEBUG [RS:2;jenkins-hbase4:34071] regionserver.HRegionServer(1478): Online Regions={3c6f124cc5357f8acdaf270484dac43a=hbase:namespace,,1689970218998.3c6f124cc5357f8acdaf270484dac43a.} 2023-07-21 20:13:07,616 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1b3082bcd4e87c68447f85e5143e2878, disabling compactions & flushes 2023-07-21 20:13:07,617 DEBUG [RS:1;jenkins-hbase4:37823] regionserver.HRegionServer(1478): Online Regions={1b3082bcd4e87c68447f85e5143e2878=hbase:acl,,1689970219757.1b3082bcd4e87c68447f85e5143e2878.} 2023-07-21 20:13:07,617 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689970218998.3c6f124cc5357f8acdaf270484dac43a. 2023-07-21 20:13:07,617 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-21 20:13:07,617 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689970218998.3c6f124cc5357f8acdaf270484dac43a. after waiting 0 ms 2023-07-21 20:13:07,617 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689970218998.3c6f124cc5357f8acdaf270484dac43a. 2023-07-21 20:13:07,617 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689970219757.1b3082bcd4e87c68447f85e5143e2878. 2023-07-21 20:13:07,617 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 3c6f124cc5357f8acdaf270484dac43a 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-21 20:13:07,617 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689970219757.1b3082bcd4e87c68447f85e5143e2878. 2023-07-21 20:13:07,617 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-21 20:13:07,617 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689970219757.1b3082bcd4e87c68447f85e5143e2878. after waiting 0 ms 2023-07-21 20:13:07,617 DEBUG [RS:0;jenkins-hbase4:40099] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-21 20:13:07,617 DEBUG [RS:2;jenkins-hbase4:34071] regionserver.HRegionServer(1504): Waiting on 3c6f124cc5357f8acdaf270484dac43a 2023-07-21 20:13:07,617 DEBUG [RS:1;jenkins-hbase4:37823] regionserver.HRegionServer(1504): Waiting on 1b3082bcd4e87c68447f85e5143e2878 2023-07-21 20:13:07,617 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-21 20:13:07,617 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689970219757.1b3082bcd4e87c68447f85e5143e2878. 2023-07-21 20:13:07,618 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-21 20:13:07,618 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-21 20:13:07,618 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1b3082bcd4e87c68447f85e5143e2878 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-07-21 20:13:07,618 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-07-21 20:13:07,656 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/hbase/namespace/3c6f124cc5357f8acdaf270484dac43a/.tmp/info/c0ecc23d079c4b30a5c50fb952486060 2023-07-21 20:13:07,674 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-21 20:13:07,675 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/hbase/acl/1b3082bcd4e87c68447f85e5143e2878/.tmp/l/c174484a1a1149bf8ba544fd90e7cfbe 2023-07-21 20:13:07,679 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-21 20:13:07,679 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/hbase/meta/1588230740/.tmp/info/29e096c4f7444da0b3efcc2790b18d78 2023-07-21 20:13:07,681 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/hbase/namespace/3c6f124cc5357f8acdaf270484dac43a/.tmp/info/c0ecc23d079c4b30a5c50fb952486060 as hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/hbase/namespace/3c6f124cc5357f8acdaf270484dac43a/info/c0ecc23d079c4b30a5c50fb952486060 2023-07-21 20:13:07,682 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c174484a1a1149bf8ba544fd90e7cfbe 2023-07-21 20:13:07,683 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/hbase/acl/1b3082bcd4e87c68447f85e5143e2878/.tmp/l/c174484a1a1149bf8ba544fd90e7cfbe as hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/hbase/acl/1b3082bcd4e87c68447f85e5143e2878/l/c174484a1a1149bf8ba544fd90e7cfbe 2023-07-21 20:13:07,683 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-21 20:13:07,684 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 29e096c4f7444da0b3efcc2790b18d78 2023-07-21 20:13:07,686 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/hbase/namespace/3c6f124cc5357f8acdaf270484dac43a/info/c0ecc23d079c4b30a5c50fb952486060, entries=2, sequenceid=6, filesize=4.8 K 2023-07-21 20:13:07,687 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 3c6f124cc5357f8acdaf270484dac43a in 70ms, sequenceid=6, compaction requested=false 2023-07-21 20:13:07,695 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/hbase/namespace/3c6f124cc5357f8acdaf270484dac43a/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-21 20:13:07,695 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 20:13:07,704 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689970218998.3c6f124cc5357f8acdaf270484dac43a. 2023-07-21 20:13:07,704 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 3c6f124cc5357f8acdaf270484dac43a: 2023-07-21 20:13:07,704 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1689970218998.3c6f124cc5357f8acdaf270484dac43a. 2023-07-21 20:13:07,705 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c174484a1a1149bf8ba544fd90e7cfbe 2023-07-21 20:13:07,705 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/hbase/acl/1b3082bcd4e87c68447f85e5143e2878/l/c174484a1a1149bf8ba544fd90e7cfbe, entries=7, sequenceid=18, filesize=5.2 K 2023-07-21 20:13:07,706 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for 1b3082bcd4e87c68447f85e5143e2878 in 88ms, sequenceid=18, compaction requested=false 2023-07-21 20:13:07,713 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/hbase/meta/1588230740/.tmp/rep_barrier/0a77433c57124f8aaa9f017085213055 2023-07-21 20:13:07,713 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/hbase/acl/1b3082bcd4e87c68447f85e5143e2878/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-07-21 20:13:07,714 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 20:13:07,715 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1689970219757.1b3082bcd4e87c68447f85e5143e2878. 2023-07-21 20:13:07,715 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1b3082bcd4e87c68447f85e5143e2878: 2023-07-21 20:13:07,715 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1689970219757.1b3082bcd4e87c68447f85e5143e2878. 2023-07-21 20:13:07,718 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0a77433c57124f8aaa9f017085213055 2023-07-21 20:13:07,730 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/hbase/meta/1588230740/.tmp/table/ecbdf18158ff493f92b33ebdb1c5323e 2023-07-21 20:13:07,734 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ecbdf18158ff493f92b33ebdb1c5323e 2023-07-21 20:13:07,735 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/hbase/meta/1588230740/.tmp/info/29e096c4f7444da0b3efcc2790b18d78 as hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/hbase/meta/1588230740/info/29e096c4f7444da0b3efcc2790b18d78 2023-07-21 20:13:07,740 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 29e096c4f7444da0b3efcc2790b18d78 2023-07-21 20:13:07,740 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/hbase/meta/1588230740/info/29e096c4f7444da0b3efcc2790b18d78, entries=48, sequenceid=131, filesize=10.3 K 2023-07-21 20:13:07,741 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/hbase/meta/1588230740/.tmp/rep_barrier/0a77433c57124f8aaa9f017085213055 as hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/hbase/meta/1588230740/rep_barrier/0a77433c57124f8aaa9f017085213055 2023-07-21 20:13:07,745 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0a77433c57124f8aaa9f017085213055 2023-07-21 20:13:07,746 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/hbase/meta/1588230740/rep_barrier/0a77433c57124f8aaa9f017085213055, entries=13, sequenceid=131, filesize=6.4 K 2023-07-21 20:13:07,746 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/hbase/meta/1588230740/.tmp/table/ecbdf18158ff493f92b33ebdb1c5323e as hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/hbase/meta/1588230740/table/ecbdf18158ff493f92b33ebdb1c5323e 2023-07-21 20:13:07,755 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ecbdf18158ff493f92b33ebdb1c5323e 2023-07-21 20:13:07,756 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/hbase/meta/1588230740/table/ecbdf18158ff493f92b33ebdb1c5323e, entries=24, sequenceid=131, filesize=6.9 K 2023-07-21 20:13:07,757 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 139ms, sequenceid=131, compaction requested=false 2023-07-21 20:13:07,774 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-07-21 20:13:07,775 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 20:13:07,775 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-21 20:13:07,776 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-21 20:13:07,776 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-21 20:13:07,776 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-21 20:13:07,818 INFO [RS:0;jenkins-hbase4:40099] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,40099,1689970215928; all regions closed. 2023-07-21 20:13:07,818 INFO [RS:1;jenkins-hbase4:37823] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,37823,1689970216018; all regions closed. 2023-07-21 20:13:07,818 INFO [RS:2;jenkins-hbase4:34071] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,34071,1689970216065; all regions closed. 2023-07-21 20:13:07,832 DEBUG [RS:0;jenkins-hbase4:40099] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/oldWALs 2023-07-21 20:13:07,832 INFO [RS:0;jenkins-hbase4:40099] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C40099%2C1689970215928.meta:.meta(num 1689970218512) 2023-07-21 20:13:07,832 DEBUG [RS:2;jenkins-hbase4:34071] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/oldWALs 2023-07-21 20:13:07,832 INFO [RS:2;jenkins-hbase4:34071] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C34071%2C1689970216065:(num 1689970218260) 2023-07-21 20:13:07,832 DEBUG [RS:2;jenkins-hbase4:34071] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 20:13:07,832 DEBUG [RS:1;jenkins-hbase4:37823] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/oldWALs 2023-07-21 20:13:07,832 INFO [RS:2;jenkins-hbase4:34071] regionserver.LeaseManager(133): Closed leases 2023-07-21 20:13:07,832 INFO [RS:1;jenkins-hbase4:37823] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C37823%2C1689970216018:(num 1689970218262) 2023-07-21 20:13:07,832 DEBUG [RS:1;jenkins-hbase4:37823] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 20:13:07,832 INFO [RS:1;jenkins-hbase4:37823] regionserver.LeaseManager(133): Closed leases 2023-07-21 20:13:07,833 INFO [RS:1;jenkins-hbase4:37823] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-21 20:13:07,833 INFO [RS:1;jenkins-hbase4:37823] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-21 20:13:07,833 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-21 20:13:07,833 INFO [RS:2;jenkins-hbase4:34071] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-21 20:13:07,833 INFO [RS:1;jenkins-hbase4:37823] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-21 20:13:07,834 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-21 20:13:07,834 INFO [RS:2;jenkins-hbase4:34071] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-21 20:13:07,834 INFO [RS:1;jenkins-hbase4:37823] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-21 20:13:07,836 INFO [RS:2;jenkins-hbase4:34071] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-21 20:13:07,836 INFO [RS:2;jenkins-hbase4:34071] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-21 20:13:07,838 INFO [RS:2;jenkins-hbase4:34071] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:34071 2023-07-21 20:13:07,838 INFO [RS:1;jenkins-hbase4:37823] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:37823 2023-07-21 20:13:07,841 DEBUG [RS:0;jenkins-hbase4:40099] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/oldWALs 2023-07-21 20:13:07,841 INFO [RS:0;jenkins-hbase4:40099] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C40099%2C1689970215928:(num 1689970218262) 2023-07-21 20:13:07,841 DEBUG [RS:0;jenkins-hbase4:40099] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 20:13:07,841 INFO [RS:0;jenkins-hbase4:40099] regionserver.LeaseManager(133): Closed leases 2023-07-21 20:13:07,842 INFO [RS:0;jenkins-hbase4:40099] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-21 20:13:07,842 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-21 20:13:07,843 INFO [RS:0;jenkins-hbase4:40099] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:40099 2023-07-21 20:13:07,846 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:13:07,846 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:13:07,846 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,37823,1689970216018 2023-07-21 20:13:07,846 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-21 20:13:07,846 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-21 20:13:07,846 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-21 20:13:07,846 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-21 20:13:07,848 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:13:07,848 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:13:07,848 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:13:07,848 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:13:07,848 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40099,1689970215928 2023-07-21 20:13:07,848 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34071,1689970216065 2023-07-21 20:13:07,850 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,37823,1689970216018] 2023-07-21 20:13:07,850 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,37823,1689970216018; numProcessing=1 2023-07-21 20:13:07,853 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,37823,1689970216018 already deleted, retry=false 2023-07-21 20:13:07,853 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,37823,1689970216018 expired; onlineServers=2 2023-07-21 20:13:07,853 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,40099,1689970215928] 2023-07-21 20:13:07,853 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,40099,1689970215928; numProcessing=2 2023-07-21 20:13:07,854 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,40099,1689970215928 already deleted, retry=false 2023-07-21 20:13:07,854 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,40099,1689970215928 expired; onlineServers=1 2023-07-21 20:13:07,854 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,34071,1689970216065] 2023-07-21 20:13:07,854 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,34071,1689970216065; numProcessing=3 2023-07-21 20:13:07,855 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,34071,1689970216065 already deleted, retry=false 2023-07-21 20:13:07,855 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,34071,1689970216065 expired; onlineServers=0 2023-07-21 20:13:07,855 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,41777,1689970214362' ***** 2023-07-21 20:13:07,855 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-21 20:13:07,856 DEBUG [M:0;jenkins-hbase4:41777] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@506882ed, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-21 20:13:07,856 INFO [M:0;jenkins-hbase4:41777] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,41777,1689970214362 2023-07-21 20:13:07,856 INFO [M:0;jenkins-hbase4:41777] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,41777,1689970214362; all regions closed. 2023-07-21 20:13:07,856 DEBUG [M:0;jenkins-hbase4:41777] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 20:13:07,856 DEBUG [M:0;jenkins-hbase4:41777] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-21 20:13:07,856 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-21 20:13:07,856 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689970217768] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689970217768,5,FailOnTimeoutGroup] 2023-07-21 20:13:07,856 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689970217782] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689970217782,5,FailOnTimeoutGroup] 2023-07-21 20:13:07,856 DEBUG [M:0;jenkins-hbase4:41777] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-21 20:13:07,856 INFO [M:0;jenkins-hbase4:41777] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-21 20:13:07,856 INFO [M:0;jenkins-hbase4:41777] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-21 20:13:07,856 INFO [M:0;jenkins-hbase4:41777] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-07-21 20:13:07,856 DEBUG [M:0;jenkins-hbase4:41777] master.HMaster(1512): Stopping service threads 2023-07-21 20:13:07,856 INFO [M:0;jenkins-hbase4:41777] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-21 20:13:07,857 ERROR [M:0;jenkins-hbase4:41777] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-22,5,PEWorkerGroup] Thread[HFileArchiver-23,5,PEWorkerGroup] 2023-07-21 20:13:07,857 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-21 20:13:07,857 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-21 20:13:07,857 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-21 20:13:07,857 INFO [M:0;jenkins-hbase4:41777] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-21 20:13:07,858 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-21 20:13:07,858 DEBUG [M:0;jenkins-hbase4:41777] zookeeper.ZKUtil(398): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-21 20:13:07,858 WARN [M:0;jenkins-hbase4:41777] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-21 20:13:07,858 INFO [M:0;jenkins-hbase4:41777] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-21 20:13:07,858 INFO [M:0;jenkins-hbase4:41777] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-21 20:13:07,859 DEBUG [M:0;jenkins-hbase4:41777] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-21 20:13:07,859 INFO [M:0;jenkins-hbase4:41777] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-21 20:13:07,859 DEBUG [M:0;jenkins-hbase4:41777] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-21 20:13:07,859 DEBUG [M:0;jenkins-hbase4:41777] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-21 20:13:07,859 DEBUG [M:0;jenkins-hbase4:41777] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-21 20:13:07,859 INFO [M:0;jenkins-hbase4:41777] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=375.63 KB heapSize=451.93 KB 2023-07-21 20:13:07,874 INFO [M:0;jenkins-hbase4:41777] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=375.63 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/dfe044743790416d9bed37b0b7c93ba6 2023-07-21 20:13:07,878 INFO [M:0;jenkins-hbase4:41777] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for dfe044743790416d9bed37b0b7c93ba6 2023-07-21 20:13:07,879 DEBUG [M:0;jenkins-hbase4:41777] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/dfe044743790416d9bed37b0b7c93ba6 as hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/dfe044743790416d9bed37b0b7c93ba6 2023-07-21 20:13:07,884 INFO [M:0;jenkins-hbase4:41777] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for dfe044743790416d9bed37b0b7c93ba6 2023-07-21 20:13:07,884 INFO [M:0;jenkins-hbase4:41777] regionserver.HStore(1080): Added hdfs://localhost:40641/user/jenkins/test-data/9724cd05-8235-dde2-7993-61629ff6db00/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/dfe044743790416d9bed37b0b7c93ba6, entries=119, sequenceid=899, filesize=28.6 K 2023-07-21 20:13:07,885 INFO [M:0;jenkins-hbase4:41777] regionserver.HRegion(2948): Finished flush of dataSize ~375.63 KB/384640, heapSize ~451.91 KB/462760, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 26ms, sequenceid=899, compaction requested=false 2023-07-21 20:13:07,887 INFO [M:0;jenkins-hbase4:41777] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-21 20:13:07,887 DEBUG [M:0;jenkins-hbase4:41777] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-21 20:13:07,892 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-21 20:13:07,892 INFO [M:0;jenkins-hbase4:41777] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-21 20:13:07,893 INFO [M:0;jenkins-hbase4:41777] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:41777 2023-07-21 20:13:07,896 DEBUG [M:0;jenkins-hbase4:41777] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,41777,1689970214362 already deleted, retry=false 2023-07-21 20:13:07,950 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-21 20:13:07,950 INFO [RS:1;jenkins-hbase4:37823] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,37823,1689970216018; zookeeper connection closed. 2023-07-21 20:13:07,950 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:37823-0x101898184d10002, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-21 20:13:07,950 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@425503d6] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@425503d6 2023-07-21 20:13:08,050 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-21 20:13:08,050 INFO [M:0;jenkins-hbase4:41777] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,41777,1689970214362; zookeeper connection closed. 2023-07-21 20:13:08,050 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): master:41777-0x101898184d10000, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-21 20:13:08,150 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-21 20:13:08,150 INFO [RS:0;jenkins-hbase4:40099] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,40099,1689970215928; zookeeper connection closed. 2023-07-21 20:13:08,150 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:40099-0x101898184d10001, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-21 20:13:08,151 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@7529d28] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@7529d28 2023-07-21 20:13:08,250 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-21 20:13:08,250 INFO [RS:2;jenkins-hbase4:34071] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,34071,1689970216065; zookeeper connection closed. 2023-07-21 20:13:08,250 DEBUG [Listener at localhost/33825-EventThread] zookeeper.ZKWatcher(600): regionserver:34071-0x101898184d10003, quorum=127.0.0.1:59101, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-21 20:13:08,251 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@4e251ba7] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@4e251ba7 2023-07-21 20:13:08,251 INFO [Listener at jenkins-hbase4.apache.org/38105] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-07-21 20:13:08,251 WARN [Listener at jenkins-hbase4.apache.org/38105] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-21 20:13:08,260 INFO [Listener at jenkins-hbase4.apache.org/38105] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-21 20:13:08,366 WARN [BP-313648603-172.31.14.131-1689970209961 heartbeating to localhost/127.0.0.1:40641] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-21 20:13:08,366 WARN [BP-313648603-172.31.14.131-1689970209961 heartbeating to localhost/127.0.0.1:40641] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-313648603-172.31.14.131-1689970209961 (Datanode Uuid fa60e01f-1ec3-4c29-94b6-ebfd47276125) service to localhost/127.0.0.1:40641 2023-07-21 20:13:08,368 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c4475fbf-6a12-c189-d7a2-889953ef4b74/cluster_35d154ca-3b63-9eae-c963-92b106b8418a/dfs/data/data5/current/BP-313648603-172.31.14.131-1689970209961] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-21 20:13:08,368 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c4475fbf-6a12-c189-d7a2-889953ef4b74/cluster_35d154ca-3b63-9eae-c963-92b106b8418a/dfs/data/data6/current/BP-313648603-172.31.14.131-1689970209961] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-21 20:13:08,369 WARN [Listener at jenkins-hbase4.apache.org/38105] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-21 20:13:08,375 INFO [Listener at jenkins-hbase4.apache.org/38105] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-21 20:13:08,479 WARN [BP-313648603-172.31.14.131-1689970209961 heartbeating to localhost/127.0.0.1:40641] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-21 20:13:08,479 WARN [BP-313648603-172.31.14.131-1689970209961 heartbeating to localhost/127.0.0.1:40641] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-313648603-172.31.14.131-1689970209961 (Datanode Uuid b9a20856-ffe0-44a1-9889-5d68d8863104) service to localhost/127.0.0.1:40641 2023-07-21 20:13:08,480 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c4475fbf-6a12-c189-d7a2-889953ef4b74/cluster_35d154ca-3b63-9eae-c963-92b106b8418a/dfs/data/data3/current/BP-313648603-172.31.14.131-1689970209961] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-21 20:13:08,480 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c4475fbf-6a12-c189-d7a2-889953ef4b74/cluster_35d154ca-3b63-9eae-c963-92b106b8418a/dfs/data/data4/current/BP-313648603-172.31.14.131-1689970209961] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-21 20:13:08,481 WARN [Listener at jenkins-hbase4.apache.org/38105] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-21 20:13:08,483 INFO [Listener at jenkins-hbase4.apache.org/38105] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-21 20:13:08,586 WARN [BP-313648603-172.31.14.131-1689970209961 heartbeating to localhost/127.0.0.1:40641] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-21 20:13:08,586 WARN [BP-313648603-172.31.14.131-1689970209961 heartbeating to localhost/127.0.0.1:40641] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-313648603-172.31.14.131-1689970209961 (Datanode Uuid 366e2780-2b85-44d9-b6b1-c9e82da1bd13) service to localhost/127.0.0.1:40641 2023-07-21 20:13:08,587 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c4475fbf-6a12-c189-d7a2-889953ef4b74/cluster_35d154ca-3b63-9eae-c963-92b106b8418a/dfs/data/data1/current/BP-313648603-172.31.14.131-1689970209961] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-21 20:13:08,587 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c4475fbf-6a12-c189-d7a2-889953ef4b74/cluster_35d154ca-3b63-9eae-c963-92b106b8418a/dfs/data/data2/current/BP-313648603-172.31.14.131-1689970209961] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-21 20:13:08,608 INFO [Listener at jenkins-hbase4.apache.org/38105] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-21 20:13:08,735 INFO [Listener at jenkins-hbase4.apache.org/38105] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-21 20:13:08,846 INFO [Listener at jenkins-hbase4.apache.org/38105] hbase.HBaseTestingUtility(1293): Minicluster is down