2023-07-12 22:13:28,788 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-07-12 22:13:29,041 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/652e6e64-efb3-f860-57fa-f551f44ecb6b 2023-07-12 22:13:29,041 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobExportSnapshot timeout: 13 mins 2023-07-12 22:13:29,042 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobSecureExportSnapshot timeout: 13 mins 2023-07-12 22:13:29,084 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-12 22:13:29,342 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-12 22:13:29,343 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/652e6e64-efb3-f860-57fa-f551f44ecb6b/cluster_dcbc62b2-e874-eae0-66ca-6b0e7e7d42e3, deleteOnExit=true 2023-07-12 22:13:29,343 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-12 22:13:29,344 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/652e6e64-efb3-f860-57fa-f551f44ecb6b/test.cache.data in system properties and HBase conf 2023-07-12 22:13:29,344 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/652e6e64-efb3-f860-57fa-f551f44ecb6b/hadoop.tmp.dir in system properties and HBase conf 2023-07-12 22:13:29,345 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/652e6e64-efb3-f860-57fa-f551f44ecb6b/hadoop.log.dir in system properties and HBase conf 2023-07-12 22:13:29,345 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/652e6e64-efb3-f860-57fa-f551f44ecb6b/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-12 22:13:29,346 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/652e6e64-efb3-f860-57fa-f551f44ecb6b/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-12 22:13:29,346 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-12 22:13:29,704 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-12 22:13:29,708 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/652e6e64-efb3-f860-57fa-f551f44ecb6b/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-12 22:13:29,709 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/652e6e64-efb3-f860-57fa-f551f44ecb6b/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-12 22:13:29,709 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/652e6e64-efb3-f860-57fa-f551f44ecb6b/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-12 22:13:29,709 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/652e6e64-efb3-f860-57fa-f551f44ecb6b/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-12 22:13:29,710 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/652e6e64-efb3-f860-57fa-f551f44ecb6b/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-12 22:13:29,710 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/652e6e64-efb3-f860-57fa-f551f44ecb6b/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-12 22:13:29,711 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/652e6e64-efb3-f860-57fa-f551f44ecb6b/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-12 22:13:29,711 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/652e6e64-efb3-f860-57fa-f551f44ecb6b/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-12 22:13:29,712 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/652e6e64-efb3-f860-57fa-f551f44ecb6b/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-12 22:13:29,712 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/652e6e64-efb3-f860-57fa-f551f44ecb6b/nfs.dump.dir in system properties and HBase conf 2023-07-12 22:13:29,713 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/652e6e64-efb3-f860-57fa-f551f44ecb6b/java.io.tmpdir in system properties and HBase conf 2023-07-12 22:13:29,713 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/652e6e64-efb3-f860-57fa-f551f44ecb6b/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-12 22:13:29,714 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/652e6e64-efb3-f860-57fa-f551f44ecb6b/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-12 22:13:29,714 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/652e6e64-efb3-f860-57fa-f551f44ecb6b/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-12 22:13:30,313 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-12 22:13:30,318 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-12 22:13:30,603 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-12 22:13:30,794 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-12 22:13:30,816 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 22:13:30,857 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 22:13:30,889 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/652e6e64-efb3-f860-57fa-f551f44ecb6b/java.io.tmpdir/Jetty_localhost_41105_hdfs____9km877/webapp 2023-07-12 22:13:31,043 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41105 2023-07-12 22:13:31,081 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-12 22:13:31,081 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-12 22:13:31,649 WARN [Listener at localhost/34335] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-12 22:13:31,730 WARN [Listener at localhost/34335] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-12 22:13:31,757 WARN [Listener at localhost/34335] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 22:13:31,765 INFO [Listener at localhost/34335] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 22:13:31,772 INFO [Listener at localhost/34335] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/652e6e64-efb3-f860-57fa-f551f44ecb6b/java.io.tmpdir/Jetty_localhost_42947_datanode____b64e91/webapp 2023-07-12 22:13:31,943 INFO [Listener at localhost/34335] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42947 2023-07-12 22:13:32,386 WARN [Listener at localhost/39543] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-12 22:13:32,498 WARN [Listener at localhost/39543] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-12 22:13:32,504 WARN [Listener at localhost/39543] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 22:13:32,508 INFO [Listener at localhost/39543] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 22:13:32,528 INFO [Listener at localhost/39543] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/652e6e64-efb3-f860-57fa-f551f44ecb6b/java.io.tmpdir/Jetty_localhost_44725_datanode____.t5jqhr/webapp 2023-07-12 22:13:32,703 INFO [Listener at localhost/39543] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44725 2023-07-12 22:13:32,748 WARN [Listener at localhost/40321] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-12 22:13:32,827 WARN [Listener at localhost/40321] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-12 22:13:32,836 WARN [Listener at localhost/40321] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 22:13:32,838 INFO [Listener at localhost/40321] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 22:13:32,861 INFO [Listener at localhost/40321] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/652e6e64-efb3-f860-57fa-f551f44ecb6b/java.io.tmpdir/Jetty_localhost_45101_datanode____.8zw7uw/webapp 2023-07-12 22:13:33,055 INFO [Listener at localhost/40321] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45101 2023-07-12 22:13:33,122 WARN [Listener at localhost/36933] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-12 22:13:33,234 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x7575d6851223ec9c: Processing first storage report for DS-3869eb7c-195a-4d0f-9bd7-35a493c00706 from datanode 29fe76f6-e699-49eb-95b3-ecbb62bab1af 2023-07-12 22:13:33,235 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x7575d6851223ec9c: from storage DS-3869eb7c-195a-4d0f-9bd7-35a493c00706 node DatanodeRegistration(127.0.0.1:34023, datanodeUuid=29fe76f6-e699-49eb-95b3-ecbb62bab1af, infoPort=44035, infoSecurePort=0, ipcPort=40321, storageInfo=lv=-57;cid=testClusterID;nsid=797894997;c=1689200010390), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-12 22:13:33,235 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x6ef96bc0d81815ef: Processing first storage report for DS-33138871-7520-4fde-8cea-4ef750421428 from datanode 500b045f-c997-4e4c-aeb0-3d9416bb97ac 2023-07-12 22:13:33,236 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x6ef96bc0d81815ef: from storage DS-33138871-7520-4fde-8cea-4ef750421428 node DatanodeRegistration(127.0.0.1:45613, datanodeUuid=500b045f-c997-4e4c-aeb0-3d9416bb97ac, infoPort=40619, infoSecurePort=0, ipcPort=39543, storageInfo=lv=-57;cid=testClusterID;nsid=797894997;c=1689200010390), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-12 22:13:33,236 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x7575d6851223ec9c: Processing first storage report for DS-d01af706-06ef-47d2-be1a-4edb877b9c5b from datanode 29fe76f6-e699-49eb-95b3-ecbb62bab1af 2023-07-12 22:13:33,236 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x7575d6851223ec9c: from storage DS-d01af706-06ef-47d2-be1a-4edb877b9c5b node DatanodeRegistration(127.0.0.1:34023, datanodeUuid=29fe76f6-e699-49eb-95b3-ecbb62bab1af, infoPort=44035, infoSecurePort=0, ipcPort=40321, storageInfo=lv=-57;cid=testClusterID;nsid=797894997;c=1689200010390), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-12 22:13:33,236 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x6ef96bc0d81815ef: Processing first storage report for DS-dba2d9ed-569d-447f-b5b5-b2deb7f940f2 from datanode 500b045f-c997-4e4c-aeb0-3d9416bb97ac 2023-07-12 22:13:33,236 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x6ef96bc0d81815ef: from storage DS-dba2d9ed-569d-447f-b5b5-b2deb7f940f2 node DatanodeRegistration(127.0.0.1:45613, datanodeUuid=500b045f-c997-4e4c-aeb0-3d9416bb97ac, infoPort=40619, infoSecurePort=0, ipcPort=39543, storageInfo=lv=-57;cid=testClusterID;nsid=797894997;c=1689200010390), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-12 22:13:33,291 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xfd84a0df44049274: Processing first storage report for DS-48f64913-d162-47aa-9fa4-b9900d3b76f3 from datanode 064d9508-305f-4b36-acef-44974d942e66 2023-07-12 22:13:33,291 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xfd84a0df44049274: from storage DS-48f64913-d162-47aa-9fa4-b9900d3b76f3 node DatanodeRegistration(127.0.0.1:33679, datanodeUuid=064d9508-305f-4b36-acef-44974d942e66, infoPort=41427, infoSecurePort=0, ipcPort=36933, storageInfo=lv=-57;cid=testClusterID;nsid=797894997;c=1689200010390), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-12 22:13:33,292 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xfd84a0df44049274: Processing first storage report for DS-92c9cd54-a5e4-4400-8850-7f8b33f07a09 from datanode 064d9508-305f-4b36-acef-44974d942e66 2023-07-12 22:13:33,292 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xfd84a0df44049274: from storage DS-92c9cd54-a5e4-4400-8850-7f8b33f07a09 node DatanodeRegistration(127.0.0.1:33679, datanodeUuid=064d9508-305f-4b36-acef-44974d942e66, infoPort=41427, infoSecurePort=0, ipcPort=36933, storageInfo=lv=-57;cid=testClusterID;nsid=797894997;c=1689200010390), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-12 22:13:33,558 DEBUG [Listener at localhost/36933] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/652e6e64-efb3-f860-57fa-f551f44ecb6b 2023-07-12 22:13:33,633 INFO [Listener at localhost/36933] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/652e6e64-efb3-f860-57fa-f551f44ecb6b/cluster_dcbc62b2-e874-eae0-66ca-6b0e7e7d42e3/zookeeper_0, clientPort=62393, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/652e6e64-efb3-f860-57fa-f551f44ecb6b/cluster_dcbc62b2-e874-eae0-66ca-6b0e7e7d42e3/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/652e6e64-efb3-f860-57fa-f551f44ecb6b/cluster_dcbc62b2-e874-eae0-66ca-6b0e7e7d42e3/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-12 22:13:33,652 INFO [Listener at localhost/36933] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=62393 2023-07-12 22:13:33,664 INFO [Listener at localhost/36933] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 22:13:33,667 INFO [Listener at localhost/36933] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 22:13:34,323 INFO [Listener at localhost/36933] util.FSUtils(471): Created version file at hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967 with version=8 2023-07-12 22:13:34,323 INFO [Listener at localhost/36933] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/hbase-staging 2023-07-12 22:13:34,670 INFO [Listener at localhost/36933] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-12 22:13:35,307 INFO [Listener at localhost/36933] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-07-12 22:13:35,342 INFO [Listener at localhost/36933] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 22:13:35,343 INFO [Listener at localhost/36933] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-12 22:13:35,343 INFO [Listener at localhost/36933] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-12 22:13:35,343 INFO [Listener at localhost/36933] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 22:13:35,343 INFO [Listener at localhost/36933] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-12 22:13:35,546 INFO [Listener at localhost/36933] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-12 22:13:35,621 DEBUG [Listener at localhost/36933] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-12 22:13:35,737 INFO [Listener at localhost/36933] ipc.NettyRpcServer(120): Bind to /172.31.14.131:43225 2023-07-12 22:13:35,756 INFO [Listener at localhost/36933] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 22:13:35,759 INFO [Listener at localhost/36933] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 22:13:35,784 INFO [Listener at localhost/36933] zookeeper.RecoverableZooKeeper(93): Process identifier=master:43225 connecting to ZooKeeper ensemble=127.0.0.1:62393 2023-07-12 22:13:35,837 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:432250x0, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-12 22:13:35,842 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:43225-0x1015b9934320000 connected 2023-07-12 22:13:35,894 DEBUG [Listener at localhost/36933] zookeeper.ZKUtil(164): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-12 22:13:35,896 DEBUG [Listener at localhost/36933] zookeeper.ZKUtil(164): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 22:13:35,914 DEBUG [Listener at localhost/36933] zookeeper.ZKUtil(164): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-12 22:13:35,938 DEBUG [Listener at localhost/36933] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=43225 2023-07-12 22:13:35,939 DEBUG [Listener at localhost/36933] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=43225 2023-07-12 22:13:35,942 DEBUG [Listener at localhost/36933] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=43225 2023-07-12 22:13:35,944 DEBUG [Listener at localhost/36933] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=43225 2023-07-12 22:13:35,948 DEBUG [Listener at localhost/36933] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=43225 2023-07-12 22:13:35,958 INFO [Listener at localhost/36933] master.HMaster(444): hbase.rootdir=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967, hbase.cluster.distributed=false 2023-07-12 22:13:36,038 INFO [Listener at localhost/36933] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-12 22:13:36,039 INFO [Listener at localhost/36933] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 22:13:36,039 INFO [Listener at localhost/36933] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-12 22:13:36,040 INFO [Listener at localhost/36933] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-12 22:13:36,040 INFO [Listener at localhost/36933] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 22:13:36,040 INFO [Listener at localhost/36933] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-12 22:13:36,047 INFO [Listener at localhost/36933] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-12 22:13:36,052 INFO [Listener at localhost/36933] ipc.NettyRpcServer(120): Bind to /172.31.14.131:37349 2023-07-12 22:13:36,056 INFO [Listener at localhost/36933] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-12 22:13:36,068 INFO [Listener at localhost/36933] mob.MobFileCache(124): MobFileCache disabled 2023-07-12 22:13:36,070 INFO [Listener at localhost/36933] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 22:13:36,072 INFO [Listener at localhost/36933] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 22:13:36,074 INFO [Listener at localhost/36933] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:37349 connecting to ZooKeeper ensemble=127.0.0.1:62393 2023-07-12 22:13:36,083 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:373490x0, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-12 22:13:36,084 DEBUG [Listener at localhost/36933] zookeeper.ZKUtil(164): regionserver:373490x0, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-12 22:13:36,091 DEBUG [Listener at localhost/36933] zookeeper.ZKUtil(164): regionserver:373490x0, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 22:13:36,091 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:37349-0x1015b9934320001 connected 2023-07-12 22:13:36,092 DEBUG [Listener at localhost/36933] zookeeper.ZKUtil(164): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-12 22:13:36,097 DEBUG [Listener at localhost/36933] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=37349 2023-07-12 22:13:36,098 DEBUG [Listener at localhost/36933] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=37349 2023-07-12 22:13:36,102 DEBUG [Listener at localhost/36933] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=37349 2023-07-12 22:13:36,111 DEBUG [Listener at localhost/36933] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=37349 2023-07-12 22:13:36,112 DEBUG [Listener at localhost/36933] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=37349 2023-07-12 22:13:36,126 INFO [Listener at localhost/36933] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-12 22:13:36,126 INFO [Listener at localhost/36933] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 22:13:36,126 INFO [Listener at localhost/36933] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-12 22:13:36,127 INFO [Listener at localhost/36933] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-12 22:13:36,127 INFO [Listener at localhost/36933] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 22:13:36,127 INFO [Listener at localhost/36933] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-12 22:13:36,128 INFO [Listener at localhost/36933] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-12 22:13:36,130 INFO [Listener at localhost/36933] ipc.NettyRpcServer(120): Bind to /172.31.14.131:40411 2023-07-12 22:13:36,130 INFO [Listener at localhost/36933] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-12 22:13:36,132 INFO [Listener at localhost/36933] mob.MobFileCache(124): MobFileCache disabled 2023-07-12 22:13:36,133 INFO [Listener at localhost/36933] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 22:13:36,141 INFO [Listener at localhost/36933] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 22:13:36,143 INFO [Listener at localhost/36933] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:40411 connecting to ZooKeeper ensemble=127.0.0.1:62393 2023-07-12 22:13:36,153 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:404110x0, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-12 22:13:36,154 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:40411-0x1015b9934320002 connected 2023-07-12 22:13:36,154 DEBUG [Listener at localhost/36933] zookeeper.ZKUtil(164): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-12 22:13:36,155 DEBUG [Listener at localhost/36933] zookeeper.ZKUtil(164): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 22:13:36,156 DEBUG [Listener at localhost/36933] zookeeper.ZKUtil(164): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-12 22:13:36,159 DEBUG [Listener at localhost/36933] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40411 2023-07-12 22:13:36,162 DEBUG [Listener at localhost/36933] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40411 2023-07-12 22:13:36,163 DEBUG [Listener at localhost/36933] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40411 2023-07-12 22:13:36,165 DEBUG [Listener at localhost/36933] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40411 2023-07-12 22:13:36,166 DEBUG [Listener at localhost/36933] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40411 2023-07-12 22:13:36,187 INFO [Listener at localhost/36933] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-12 22:13:36,187 INFO [Listener at localhost/36933] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 22:13:36,187 INFO [Listener at localhost/36933] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-12 22:13:36,187 INFO [Listener at localhost/36933] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-12 22:13:36,188 INFO [Listener at localhost/36933] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 22:13:36,188 INFO [Listener at localhost/36933] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-12 22:13:36,188 INFO [Listener at localhost/36933] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-12 22:13:36,190 INFO [Listener at localhost/36933] ipc.NettyRpcServer(120): Bind to /172.31.14.131:34497 2023-07-12 22:13:36,190 INFO [Listener at localhost/36933] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-12 22:13:36,191 INFO [Listener at localhost/36933] mob.MobFileCache(124): MobFileCache disabled 2023-07-12 22:13:36,193 INFO [Listener at localhost/36933] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 22:13:36,196 INFO [Listener at localhost/36933] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 22:13:36,198 INFO [Listener at localhost/36933] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:34497 connecting to ZooKeeper ensemble=127.0.0.1:62393 2023-07-12 22:13:36,205 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:344970x0, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-12 22:13:36,206 DEBUG [Listener at localhost/36933] zookeeper.ZKUtil(164): regionserver:344970x0, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-12 22:13:36,206 DEBUG [Listener at localhost/36933] zookeeper.ZKUtil(164): regionserver:344970x0, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 22:13:36,207 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:34497-0x1015b9934320003 connected 2023-07-12 22:13:36,207 DEBUG [Listener at localhost/36933] zookeeper.ZKUtil(164): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-12 22:13:36,210 DEBUG [Listener at localhost/36933] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=34497 2023-07-12 22:13:36,210 DEBUG [Listener at localhost/36933] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=34497 2023-07-12 22:13:36,212 DEBUG [Listener at localhost/36933] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=34497 2023-07-12 22:13:36,215 DEBUG [Listener at localhost/36933] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=34497 2023-07-12 22:13:36,215 DEBUG [Listener at localhost/36933] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=34497 2023-07-12 22:13:36,218 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,43225,1689200014499 2023-07-12 22:13:36,228 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-12 22:13:36,229 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,43225,1689200014499 2023-07-12 22:13:36,254 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-12 22:13:36,255 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-12 22:13:36,255 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-12 22:13:36,255 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-12 22:13:36,256 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 22:13:36,258 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-12 22:13:36,260 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,43225,1689200014499 from backup master directory 2023-07-12 22:13:36,261 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-12 22:13:36,265 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,43225,1689200014499 2023-07-12 22:13:36,265 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-12 22:13:36,266 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-12 22:13:36,266 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,43225,1689200014499 2023-07-12 22:13:36,270 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-12 22:13:36,273 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-12 22:13:36,386 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/hbase.id with ID: 27347421-a797-46e6-b544-0f045aebdf1c 2023-07-12 22:13:36,429 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 22:13:36,445 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 22:13:36,509 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x4f909175 to 127.0.0.1:62393 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 22:13:36,548 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3605a698, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 22:13:36,583 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-12 22:13:36,585 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-12 22:13:36,613 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-12 22:13:36,613 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-12 22:13:36,616 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-12 22:13:36,622 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-12 22:13:36,623 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-12 22:13:36,666 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/MasterData/data/master/store-tmp 2023-07-12 22:13:36,744 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 22:13:36,745 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-12 22:13:36,745 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 22:13:36,745 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 22:13:36,745 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-12 22:13:36,745 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 22:13:36,745 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 22:13:36,745 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-12 22:13:36,747 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/MasterData/WALs/jenkins-hbase4.apache.org,43225,1689200014499 2023-07-12 22:13:36,776 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43225%2C1689200014499, suffix=, logDir=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/MasterData/WALs/jenkins-hbase4.apache.org,43225,1689200014499, archiveDir=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/MasterData/oldWALs, maxLogs=10 2023-07-12 22:13:36,867 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33679,DS-48f64913-d162-47aa-9fa4-b9900d3b76f3,DISK] 2023-07-12 22:13:36,867 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45613,DS-33138871-7520-4fde-8cea-4ef750421428,DISK] 2023-07-12 22:13:36,870 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34023,DS-3869eb7c-195a-4d0f-9bd7-35a493c00706,DISK] 2023-07-12 22:13:36,879 DEBUG [RS-EventLoopGroup-5-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 22:13:36,967 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/MasterData/WALs/jenkins-hbase4.apache.org,43225,1689200014499/jenkins-hbase4.apache.org%2C43225%2C1689200014499.1689200016791 2023-07-12 22:13:36,967 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33679,DS-48f64913-d162-47aa-9fa4-b9900d3b76f3,DISK], DatanodeInfoWithStorage[127.0.0.1:34023,DS-3869eb7c-195a-4d0f-9bd7-35a493c00706,DISK], DatanodeInfoWithStorage[127.0.0.1:45613,DS-33138871-7520-4fde-8cea-4ef750421428,DISK]] 2023-07-12 22:13:36,968 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-12 22:13:36,969 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 22:13:36,973 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-12 22:13:36,974 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-12 22:13:37,044 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-12 22:13:37,052 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-12 22:13:37,082 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-12 22:13:37,097 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 22:13:37,104 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-12 22:13:37,106 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-12 22:13:37,123 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-12 22:13:37,128 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 22:13:37,129 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64387499, jitterRate=-0.04055149853229523}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 22:13:37,130 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-12 22:13:37,132 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-12 22:13:37,157 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-12 22:13:37,157 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-12 22:13:37,160 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-12 22:13:37,162 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-12 22:13:37,204 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 41 msec 2023-07-12 22:13:37,204 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-12 22:13:37,243 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-12 22:13:37,249 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-12 22:13:37,279 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-12 22:13:37,284 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-12 22:13:37,286 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-12 22:13:37,294 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-12 22:13:37,300 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-12 22:13:37,306 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 22:13:37,308 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-12 22:13:37,309 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-12 22:13:37,327 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-12 22:13:37,333 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-12 22:13:37,333 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-12 22:13:37,333 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 22:13:37,333 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-12 22:13:37,333 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-12 22:13:37,334 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,43225,1689200014499, sessionid=0x1015b9934320000, setting cluster-up flag (Was=false) 2023-07-12 22:13:37,356 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 22:13:37,365 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-12 22:13:37,367 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,43225,1689200014499 2023-07-12 22:13:37,374 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 22:13:37,381 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-12 22:13:37,391 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,43225,1689200014499 2023-07-12 22:13:37,395 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.hbase-snapshot/.tmp 2023-07-12 22:13:37,436 INFO [RS:1;jenkins-hbase4:40411] regionserver.HRegionServer(951): ClusterId : 27347421-a797-46e6-b544-0f045aebdf1c 2023-07-12 22:13:37,438 INFO [RS:0;jenkins-hbase4:37349] regionserver.HRegionServer(951): ClusterId : 27347421-a797-46e6-b544-0f045aebdf1c 2023-07-12 22:13:37,443 INFO [RS:2;jenkins-hbase4:34497] regionserver.HRegionServer(951): ClusterId : 27347421-a797-46e6-b544-0f045aebdf1c 2023-07-12 22:13:37,449 DEBUG [RS:0;jenkins-hbase4:37349] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-12 22:13:37,449 DEBUG [RS:1;jenkins-hbase4:40411] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-12 22:13:37,449 DEBUG [RS:2;jenkins-hbase4:34497] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-12 22:13:37,463 DEBUG [RS:1;jenkins-hbase4:40411] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-12 22:13:37,463 DEBUG [RS:0;jenkins-hbase4:37349] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-12 22:13:37,463 DEBUG [RS:2;jenkins-hbase4:34497] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-12 22:13:37,463 DEBUG [RS:0;jenkins-hbase4:37349] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-12 22:13:37,463 DEBUG [RS:1;jenkins-hbase4:40411] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-12 22:13:37,463 DEBUG [RS:2;jenkins-hbase4:34497] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-12 22:13:37,472 DEBUG [RS:1;jenkins-hbase4:40411] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-12 22:13:37,472 DEBUG [RS:0;jenkins-hbase4:37349] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-12 22:13:37,473 DEBUG [RS:1;jenkins-hbase4:40411] zookeeper.ReadOnlyZKClient(139): Connect 0x3d3c59db to 127.0.0.1:62393 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 22:13:37,475 DEBUG [RS:0;jenkins-hbase4:37349] zookeeper.ReadOnlyZKClient(139): Connect 0x40d64d40 to 127.0.0.1:62393 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 22:13:37,476 DEBUG [RS:2;jenkins-hbase4:34497] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-12 22:13:37,487 DEBUG [RS:2;jenkins-hbase4:34497] zookeeper.ReadOnlyZKClient(139): Connect 0x62c3a692 to 127.0.0.1:62393 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 22:13:37,504 DEBUG [RS:0;jenkins-hbase4:37349] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@173bea8f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 22:13:37,524 DEBUG [RS:0;jenkins-hbase4:37349] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2331c11d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-12 22:13:37,528 DEBUG [RS:1;jenkins-hbase4:40411] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@261fd466, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 22:13:37,529 DEBUG [RS:1;jenkins-hbase4:40411] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7630a57d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-12 22:13:37,547 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-07-12 22:13:37,553 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 22:13:37,553 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-07-12 22:13:37,556 DEBUG [RS:2;jenkins-hbase4:34497] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6c0454ba, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 22:13:37,557 DEBUG [RS:2;jenkins-hbase4:34497] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2d395e81, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-12 22:13:37,580 DEBUG [RS:0;jenkins-hbase4:37349] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:37349 2023-07-12 22:13:37,585 INFO [RS:0;jenkins-hbase4:37349] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-12 22:13:37,585 INFO [RS:0;jenkins-hbase4:37349] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-12 22:13:37,586 DEBUG [RS:0;jenkins-hbase4:37349] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-12 22:13:37,587 INFO [RS:0;jenkins-hbase4:37349] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 22:13:37,590 DEBUG [RS:0;jenkins-hbase4:37349] regionserver.HRegionServer(1022): About to register with Master. 2023-07-12 22:13:37,594 INFO [RS:0;jenkins-hbase4:37349] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,43225,1689200014499 with isa=jenkins-hbase4.apache.org/172.31.14.131:37349, startcode=1689200016037 2023-07-12 22:13:37,605 DEBUG [RS:2;jenkins-hbase4:34497] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:34497 2023-07-12 22:13:37,603 DEBUG [RS:1;jenkins-hbase4:40411] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:40411 2023-07-12 22:13:37,605 INFO [RS:2;jenkins-hbase4:34497] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-12 22:13:37,606 INFO [RS:1;jenkins-hbase4:40411] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-12 22:13:37,606 INFO [RS:2;jenkins-hbase4:34497] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-12 22:13:37,606 INFO [RS:1;jenkins-hbase4:40411] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-12 22:13:37,606 DEBUG [RS:2;jenkins-hbase4:34497] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-12 22:13:37,606 DEBUG [RS:1;jenkins-hbase4:40411] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-12 22:13:37,607 INFO [RS:2;jenkins-hbase4:34497] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 22:13:37,607 DEBUG [RS:2;jenkins-hbase4:34497] regionserver.HRegionServer(1022): About to register with Master. 2023-07-12 22:13:37,607 INFO [RS:1;jenkins-hbase4:40411] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 22:13:37,607 DEBUG [RS:1;jenkins-hbase4:40411] regionserver.HRegionServer(1022): About to register with Master. 2023-07-12 22:13:37,608 INFO [RS:2;jenkins-hbase4:34497] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,43225,1689200014499 with isa=jenkins-hbase4.apache.org/172.31.14.131:34497, startcode=1689200016186 2023-07-12 22:13:37,608 INFO [RS:1;jenkins-hbase4:40411] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,43225,1689200014499 with isa=jenkins-hbase4.apache.org/172.31.14.131:40411, startcode=1689200016125 2023-07-12 22:13:37,619 DEBUG [RS:2;jenkins-hbase4:34497] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-12 22:13:37,619 DEBUG [RS:1;jenkins-hbase4:40411] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-12 22:13:37,619 DEBUG [RS:0;jenkins-hbase4:37349] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-12 22:13:37,695 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-12 22:13:37,706 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33133, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-07-12 22:13:37,706 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37829, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-12 22:13:37,718 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43225] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-12 22:13:37,720 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-12 22:13:37,720 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-12 22:13:37,720 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-12 22:13:37,720 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-12 22:13:37,720 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-07-12 22:13:37,720 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 22:13:37,721 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-12 22:13:37,706 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57731, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-07-12 22:13:37,721 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 22:13:37,727 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43225] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-12 22:13:37,728 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43225] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-12 22:13:37,764 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689200047764 2023-07-12 22:13:37,766 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-12 22:13:37,769 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-12 22:13:37,770 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-12 22:13:37,775 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-12 22:13:37,780 DEBUG [RS:1;jenkins-hbase4:40411] regionserver.HRegionServer(2830): Master is not running yet 2023-07-12 22:13:37,780 DEBUG [RS:2;jenkins-hbase4:34497] regionserver.HRegionServer(2830): Master is not running yet 2023-07-12 22:13:37,780 DEBUG [RS:0;jenkins-hbase4:37349] regionserver.HRegionServer(2830): Master is not running yet 2023-07-12 22:13:37,780 WARN [RS:1;jenkins-hbase4:40411] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-12 22:13:37,781 WARN [RS:2;jenkins-hbase4:34497] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-12 22:13:37,782 WARN [RS:0;jenkins-hbase4:37349] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-12 22:13:37,782 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-12 22:13:37,790 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-12 22:13:37,791 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-12 22:13:37,791 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-12 22:13:37,791 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-12 22:13:37,792 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-12 22:13:37,794 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-12 22:13:37,796 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-12 22:13:37,796 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-12 22:13:37,807 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-12 22:13:37,807 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-12 22:13:37,822 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689200017811,5,FailOnTimeoutGroup] 2023-07-12 22:13:37,827 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689200017826,5,FailOnTimeoutGroup] 2023-07-12 22:13:37,827 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-12 22:13:37,827 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-12 22:13:37,829 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-12 22:13:37,829 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-12 22:13:37,884 INFO [RS:0;jenkins-hbase4:37349] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,43225,1689200014499 with isa=jenkins-hbase4.apache.org/172.31.14.131:37349, startcode=1689200016037 2023-07-12 22:13:37,884 INFO [RS:2;jenkins-hbase4:34497] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,43225,1689200014499 with isa=jenkins-hbase4.apache.org/172.31.14.131:34497, startcode=1689200016186 2023-07-12 22:13:37,884 INFO [RS:1;jenkins-hbase4:40411] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,43225,1689200014499 with isa=jenkins-hbase4.apache.org/172.31.14.131:40411, startcode=1689200016125 2023-07-12 22:13:37,888 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-12 22:13:37,889 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-12 22:13:37,889 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967 2023-07-12 22:13:37,892 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43225] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:13:37,903 DEBUG [RS:0;jenkins-hbase4:37349] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967 2023-07-12 22:13:37,903 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43225] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:13:37,905 DEBUG [RS:0;jenkins-hbase4:37349] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:34335 2023-07-12 22:13:37,905 DEBUG [RS:0;jenkins-hbase4:37349] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-12 22:13:37,908 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43225] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:13:37,924 DEBUG [RS:1;jenkins-hbase4:40411] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967 2023-07-12 22:13:37,925 DEBUG [RS:1;jenkins-hbase4:40411] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:34335 2023-07-12 22:13:37,924 DEBUG [RS:2;jenkins-hbase4:34497] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967 2023-07-12 22:13:37,925 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-12 22:13:37,925 DEBUG [RS:1;jenkins-hbase4:40411] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-12 22:13:37,925 DEBUG [RS:2;jenkins-hbase4:34497] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:34335 2023-07-12 22:13:37,926 DEBUG [RS:2;jenkins-hbase4:34497] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-12 22:13:37,926 DEBUG [RS:0;jenkins-hbase4:37349] zookeeper.ZKUtil(162): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:13:37,926 WARN [RS:0;jenkins-hbase4:37349] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-12 22:13:37,935 INFO [RS:0;jenkins-hbase4:37349] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-12 22:13:37,936 DEBUG [RS:0;jenkins-hbase4:37349] regionserver.HRegionServer(1948): logDir=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/WALs/jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:13:37,937 DEBUG [RS:1;jenkins-hbase4:40411] zookeeper.ZKUtil(162): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:13:37,937 WARN [RS:1;jenkins-hbase4:40411] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-12 22:13:37,937 INFO [RS:1;jenkins-hbase4:40411] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-12 22:13:37,938 DEBUG [RS:1;jenkins-hbase4:40411] regionserver.HRegionServer(1948): logDir=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/WALs/jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:13:37,939 DEBUG [RS:2;jenkins-hbase4:34497] zookeeper.ZKUtil(162): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:13:37,940 WARN [RS:2;jenkins-hbase4:34497] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-12 22:13:37,940 INFO [RS:2;jenkins-hbase4:34497] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-12 22:13:37,940 DEBUG [RS:2;jenkins-hbase4:34497] regionserver.HRegionServer(1948): logDir=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/WALs/jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:13:37,946 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,37349,1689200016037] 2023-07-12 22:13:37,953 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,34497,1689200016186] 2023-07-12 22:13:37,953 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,40411,1689200016125] 2023-07-12 22:13:37,975 DEBUG [RS:2;jenkins-hbase4:34497] zookeeper.ZKUtil(162): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:13:37,975 DEBUG [RS:0;jenkins-hbase4:37349] zookeeper.ZKUtil(162): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:13:37,975 DEBUG [RS:2;jenkins-hbase4:34497] zookeeper.ZKUtil(162): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:13:37,975 DEBUG [RS:0;jenkins-hbase4:37349] zookeeper.ZKUtil(162): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:13:37,976 DEBUG [RS:2;jenkins-hbase4:34497] zookeeper.ZKUtil(162): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:13:37,976 DEBUG [RS:0;jenkins-hbase4:37349] zookeeper.ZKUtil(162): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:13:37,984 DEBUG [RS:1;jenkins-hbase4:40411] zookeeper.ZKUtil(162): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:13:37,984 DEBUG [RS:1;jenkins-hbase4:40411] zookeeper.ZKUtil(162): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:13:37,985 DEBUG [RS:1;jenkins-hbase4:40411] zookeeper.ZKUtil(162): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:13:37,994 DEBUG [RS:2;jenkins-hbase4:34497] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-12 22:13:37,994 DEBUG [RS:0;jenkins-hbase4:37349] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-12 22:13:37,994 DEBUG [RS:1;jenkins-hbase4:40411] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-12 22:13:38,029 INFO [RS:1;jenkins-hbase4:40411] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-12 22:13:38,030 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 22:13:38,031 INFO [RS:0;jenkins-hbase4:37349] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-12 22:13:38,037 INFO [RS:2;jenkins-hbase4:34497] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-12 22:13:38,048 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-12 22:13:38,051 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/hbase/meta/1588230740/info 2023-07-12 22:13:38,052 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-12 22:13:38,054 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 22:13:38,055 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-12 22:13:38,068 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/hbase/meta/1588230740/rep_barrier 2023-07-12 22:13:38,069 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-12 22:13:38,070 INFO [RS:1;jenkins-hbase4:40411] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-12 22:13:38,075 INFO [RS:0;jenkins-hbase4:37349] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-12 22:13:38,070 INFO [RS:2;jenkins-hbase4:34497] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-12 22:13:38,070 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 22:13:38,080 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-12 22:13:38,083 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/hbase/meta/1588230740/table 2023-07-12 22:13:38,083 INFO [RS:1;jenkins-hbase4:40411] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-12 22:13:38,084 INFO [RS:1;jenkins-hbase4:40411] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 22:13:38,084 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-12 22:13:38,085 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 22:13:38,088 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/hbase/meta/1588230740 2023-07-12 22:13:38,087 INFO [RS:2;jenkins-hbase4:34497] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-12 22:13:38,083 INFO [RS:0;jenkins-hbase4:37349] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-12 22:13:38,096 INFO [RS:2;jenkins-hbase4:34497] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 22:13:38,096 INFO [RS:1;jenkins-hbase4:40411] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-12 22:13:38,097 INFO [RS:0;jenkins-hbase4:37349] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 22:13:38,097 INFO [RS:2;jenkins-hbase4:34497] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-12 22:13:38,097 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/hbase/meta/1588230740 2023-07-12 22:13:38,097 INFO [RS:0;jenkins-hbase4:37349] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-12 22:13:38,102 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 22:13:38,105 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-12 22:13:38,107 INFO [RS:0;jenkins-hbase4:37349] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-12 22:13:38,107 INFO [RS:2;jenkins-hbase4:34497] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-12 22:13:38,107 DEBUG [RS:0;jenkins-hbase4:37349] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 22:13:38,107 INFO [RS:1;jenkins-hbase4:40411] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-12 22:13:38,108 DEBUG [RS:0;jenkins-hbase4:37349] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 22:13:38,108 DEBUG [RS:1;jenkins-hbase4:40411] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 22:13:38,108 DEBUG [RS:0;jenkins-hbase4:37349] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 22:13:38,108 DEBUG [RS:1;jenkins-hbase4:40411] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 22:13:38,108 DEBUG [RS:0;jenkins-hbase4:37349] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 22:13:38,108 DEBUG [RS:1;jenkins-hbase4:40411] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 22:13:38,108 DEBUG [RS:0;jenkins-hbase4:37349] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 22:13:38,108 DEBUG [RS:1;jenkins-hbase4:40411] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 22:13:38,109 DEBUG [RS:0;jenkins-hbase4:37349] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-12 22:13:38,109 DEBUG [RS:1;jenkins-hbase4:40411] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 22:13:38,109 DEBUG [RS:0;jenkins-hbase4:37349] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 22:13:38,109 DEBUG [RS:1;jenkins-hbase4:40411] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-12 22:13:38,109 DEBUG [RS:0;jenkins-hbase4:37349] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 22:13:38,109 DEBUG [RS:1;jenkins-hbase4:40411] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 22:13:38,109 DEBUG [RS:0;jenkins-hbase4:37349] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 22:13:38,109 DEBUG [RS:1;jenkins-hbase4:40411] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 22:13:38,107 DEBUG [RS:2;jenkins-hbase4:34497] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 22:13:38,109 DEBUG [RS:1;jenkins-hbase4:40411] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 22:13:38,109 DEBUG [RS:2;jenkins-hbase4:34497] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 22:13:38,109 DEBUG [RS:1;jenkins-hbase4:40411] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 22:13:38,109 DEBUG [RS:2;jenkins-hbase4:34497] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 22:13:38,109 DEBUG [RS:0;jenkins-hbase4:37349] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 22:13:38,109 DEBUG [RS:2;jenkins-hbase4:34497] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 22:13:38,110 DEBUG [RS:2;jenkins-hbase4:34497] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 22:13:38,110 DEBUG [RS:2;jenkins-hbase4:34497] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-12 22:13:38,110 DEBUG [RS:2;jenkins-hbase4:34497] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 22:13:38,110 DEBUG [RS:2;jenkins-hbase4:34497] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 22:13:38,110 DEBUG [RS:2;jenkins-hbase4:34497] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 22:13:38,110 DEBUG [RS:2;jenkins-hbase4:34497] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 22:13:38,116 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 22:13:38,118 INFO [RS:1;jenkins-hbase4:40411] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-12 22:13:38,119 INFO [RS:1;jenkins-hbase4:40411] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-12 22:13:38,119 INFO [RS:2;jenkins-hbase4:34497] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-12 22:13:38,119 INFO [RS:1;jenkins-hbase4:40411] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-12 22:13:38,119 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58851991, jitterRate=-0.12303699553012848}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 22:13:38,119 INFO [RS:0;jenkins-hbase4:37349] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-12 22:13:38,119 INFO [RS:2;jenkins-hbase4:34497] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-12 22:13:38,119 INFO [RS:2;jenkins-hbase4:34497] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-12 22:13:38,119 INFO [RS:0;jenkins-hbase4:37349] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-12 22:13:38,119 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-12 22:13:38,119 INFO [RS:0;jenkins-hbase4:37349] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-12 22:13:38,119 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-12 22:13:38,120 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-12 22:13:38,120 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-12 22:13:38,120 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-12 22:13:38,120 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-12 22:13:38,124 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-12 22:13:38,124 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-12 22:13:38,132 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-12 22:13:38,132 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-12 22:13:38,141 INFO [RS:1;jenkins-hbase4:40411] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-12 22:13:38,144 INFO [RS:0;jenkins-hbase4:37349] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-12 22:13:38,146 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-12 22:13:38,149 INFO [RS:2;jenkins-hbase4:34497] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-12 22:13:38,156 INFO [RS:0;jenkins-hbase4:37349] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37349,1689200016037-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 22:13:38,156 INFO [RS:1;jenkins-hbase4:40411] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40411,1689200016125-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 22:13:38,156 INFO [RS:2;jenkins-hbase4:34497] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34497,1689200016186-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 22:13:38,164 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-12 22:13:38,169 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-12 22:13:38,186 INFO [RS:0;jenkins-hbase4:37349] regionserver.Replication(203): jenkins-hbase4.apache.org,37349,1689200016037 started 2023-07-12 22:13:38,186 INFO [RS:0;jenkins-hbase4:37349] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,37349,1689200016037, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:37349, sessionid=0x1015b9934320001 2023-07-12 22:13:38,188 INFO [RS:2;jenkins-hbase4:34497] regionserver.Replication(203): jenkins-hbase4.apache.org,34497,1689200016186 started 2023-07-12 22:13:38,188 INFO [RS:2;jenkins-hbase4:34497] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,34497,1689200016186, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:34497, sessionid=0x1015b9934320003 2023-07-12 22:13:38,188 DEBUG [RS:2;jenkins-hbase4:34497] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-12 22:13:38,188 DEBUG [RS:2;jenkins-hbase4:34497] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:13:38,188 DEBUG [RS:2;jenkins-hbase4:34497] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34497,1689200016186' 2023-07-12 22:13:38,189 DEBUG [RS:2;jenkins-hbase4:34497] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 22:13:38,189 DEBUG [RS:2;jenkins-hbase4:34497] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 22:13:38,191 DEBUG [RS:2;jenkins-hbase4:34497] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-12 22:13:38,192 DEBUG [RS:2;jenkins-hbase4:34497] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-12 22:13:38,192 DEBUG [RS:2;jenkins-hbase4:34497] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:13:38,192 DEBUG [RS:2;jenkins-hbase4:34497] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34497,1689200016186' 2023-07-12 22:13:38,192 DEBUG [RS:2;jenkins-hbase4:34497] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:13:38,201 DEBUG [RS:2;jenkins-hbase4:34497] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:13:38,201 INFO [RS:1;jenkins-hbase4:40411] regionserver.Replication(203): jenkins-hbase4.apache.org,40411,1689200016125 started 2023-07-12 22:13:38,202 DEBUG [RS:2;jenkins-hbase4:34497] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-12 22:13:38,201 DEBUG [RS:0;jenkins-hbase4:37349] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-12 22:13:38,202 INFO [RS:2;jenkins-hbase4:34497] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-12 22:13:38,202 INFO [RS:1;jenkins-hbase4:40411] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,40411,1689200016125, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:40411, sessionid=0x1015b9934320002 2023-07-12 22:13:38,203 INFO [RS:2;jenkins-hbase4:34497] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-12 22:13:38,202 DEBUG [RS:0;jenkins-hbase4:37349] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:13:38,204 DEBUG [RS:0;jenkins-hbase4:37349] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,37349,1689200016037' 2023-07-12 22:13:38,211 DEBUG [RS:0;jenkins-hbase4:37349] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 22:13:38,212 DEBUG [RS:0;jenkins-hbase4:37349] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 22:13:38,213 DEBUG [RS:0;jenkins-hbase4:37349] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-12 22:13:38,213 DEBUG [RS:0;jenkins-hbase4:37349] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-12 22:13:38,213 DEBUG [RS:0;jenkins-hbase4:37349] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:13:38,214 DEBUG [RS:0;jenkins-hbase4:37349] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,37349,1689200016037' 2023-07-12 22:13:38,214 DEBUG [RS:0;jenkins-hbase4:37349] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:13:38,214 DEBUG [RS:1;jenkins-hbase4:40411] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-12 22:13:38,214 DEBUG [RS:1;jenkins-hbase4:40411] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:13:38,214 DEBUG [RS:1;jenkins-hbase4:40411] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40411,1689200016125' 2023-07-12 22:13:38,214 DEBUG [RS:1;jenkins-hbase4:40411] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 22:13:38,215 DEBUG [RS:1;jenkins-hbase4:40411] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 22:13:38,215 DEBUG [RS:1;jenkins-hbase4:40411] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-12 22:13:38,215 DEBUG [RS:1;jenkins-hbase4:40411] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-12 22:13:38,215 DEBUG [RS:1;jenkins-hbase4:40411] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:13:38,216 DEBUG [RS:1;jenkins-hbase4:40411] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40411,1689200016125' 2023-07-12 22:13:38,216 DEBUG [RS:1;jenkins-hbase4:40411] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:13:38,216 DEBUG [RS:1;jenkins-hbase4:40411] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:13:38,217 DEBUG [RS:1;jenkins-hbase4:40411] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-12 22:13:38,217 INFO [RS:1;jenkins-hbase4:40411] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-12 22:13:38,217 INFO [RS:1;jenkins-hbase4:40411] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-12 22:13:38,220 DEBUG [RS:0;jenkins-hbase4:37349] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:13:38,221 DEBUG [RS:0;jenkins-hbase4:37349] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-12 22:13:38,221 INFO [RS:0;jenkins-hbase4:37349] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-12 22:13:38,221 INFO [RS:0;jenkins-hbase4:37349] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-12 22:13:38,321 DEBUG [jenkins-hbase4:43225] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-07-12 22:13:38,327 DEBUG [jenkins-hbase4:43225] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-12 22:13:38,333 INFO [RS:1;jenkins-hbase4:40411] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40411%2C1689200016125, suffix=, logDir=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/WALs/jenkins-hbase4.apache.org,40411,1689200016125, archiveDir=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/oldWALs, maxLogs=32 2023-07-12 22:13:38,337 DEBUG [jenkins-hbase4:43225] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 22:13:38,337 DEBUG [jenkins-hbase4:43225] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 22:13:38,337 DEBUG [jenkins-hbase4:43225] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-12 22:13:38,337 DEBUG [jenkins-hbase4:43225] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 22:13:38,340 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,40411,1689200016125, state=OPENING 2023-07-12 22:13:38,347 INFO [RS:0;jenkins-hbase4:37349] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C37349%2C1689200016037, suffix=, logDir=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/WALs/jenkins-hbase4.apache.org,37349,1689200016037, archiveDir=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/oldWALs, maxLogs=32 2023-07-12 22:13:38,356 INFO [RS:2;jenkins-hbase4:34497] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C34497%2C1689200016186, suffix=, logDir=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/WALs/jenkins-hbase4.apache.org,34497,1689200016186, archiveDir=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/oldWALs, maxLogs=32 2023-07-12 22:13:38,372 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-12 22:13:38,376 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33679,DS-48f64913-d162-47aa-9fa4-b9900d3b76f3,DISK] 2023-07-12 22:13:38,376 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34023,DS-3869eb7c-195a-4d0f-9bd7-35a493c00706,DISK] 2023-07-12 22:13:38,392 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 22:13:38,393 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-12 22:13:38,398 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,40411,1689200016125}] 2023-07-12 22:13:38,440 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45613,DS-33138871-7520-4fde-8cea-4ef750421428,DISK] 2023-07-12 22:13:38,441 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33679,DS-48f64913-d162-47aa-9fa4-b9900d3b76f3,DISK] 2023-07-12 22:13:38,441 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34023,DS-3869eb7c-195a-4d0f-9bd7-35a493c00706,DISK] 2023-07-12 22:13:38,441 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45613,DS-33138871-7520-4fde-8cea-4ef750421428,DISK] 2023-07-12 22:13:38,453 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33679,DS-48f64913-d162-47aa-9fa4-b9900d3b76f3,DISK] 2023-07-12 22:13:38,453 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34023,DS-3869eb7c-195a-4d0f-9bd7-35a493c00706,DISK] 2023-07-12 22:13:38,453 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45613,DS-33138871-7520-4fde-8cea-4ef750421428,DISK] 2023-07-12 22:13:38,461 INFO [RS:1;jenkins-hbase4:40411] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/WALs/jenkins-hbase4.apache.org,40411,1689200016125/jenkins-hbase4.apache.org%2C40411%2C1689200016125.1689200018336 2023-07-12 22:13:38,461 INFO [RS:0;jenkins-hbase4:37349] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/WALs/jenkins-hbase4.apache.org,37349,1689200016037/jenkins-hbase4.apache.org%2C37349%2C1689200016037.1689200018349 2023-07-12 22:13:38,467 DEBUG [RS:0;jenkins-hbase4:37349] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45613,DS-33138871-7520-4fde-8cea-4ef750421428,DISK], DatanodeInfoWithStorage[127.0.0.1:34023,DS-3869eb7c-195a-4d0f-9bd7-35a493c00706,DISK], DatanodeInfoWithStorage[127.0.0.1:33679,DS-48f64913-d162-47aa-9fa4-b9900d3b76f3,DISK]] 2023-07-12 22:13:38,470 DEBUG [RS:1;jenkins-hbase4:40411] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45613,DS-33138871-7520-4fde-8cea-4ef750421428,DISK], DatanodeInfoWithStorage[127.0.0.1:33679,DS-48f64913-d162-47aa-9fa4-b9900d3b76f3,DISK], DatanodeInfoWithStorage[127.0.0.1:34023,DS-3869eb7c-195a-4d0f-9bd7-35a493c00706,DISK]] 2023-07-12 22:13:38,470 INFO [RS:2;jenkins-hbase4:34497] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/WALs/jenkins-hbase4.apache.org,34497,1689200016186/jenkins-hbase4.apache.org%2C34497%2C1689200016186.1689200018358 2023-07-12 22:13:38,472 DEBUG [RS:2;jenkins-hbase4:34497] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45613,DS-33138871-7520-4fde-8cea-4ef750421428,DISK], DatanodeInfoWithStorage[127.0.0.1:33679,DS-48f64913-d162-47aa-9fa4-b9900d3b76f3,DISK], DatanodeInfoWithStorage[127.0.0.1:34023,DS-3869eb7c-195a-4d0f-9bd7-35a493c00706,DISK]] 2023-07-12 22:13:38,655 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:13:38,659 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-12 22:13:38,663 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56976, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-12 22:13:38,681 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-12 22:13:38,682 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-12 22:13:38,686 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40411%2C1689200016125.meta, suffix=.meta, logDir=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/WALs/jenkins-hbase4.apache.org,40411,1689200016125, archiveDir=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/oldWALs, maxLogs=32 2023-07-12 22:13:38,717 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34023,DS-3869eb7c-195a-4d0f-9bd7-35a493c00706,DISK] 2023-07-12 22:13:38,722 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45613,DS-33138871-7520-4fde-8cea-4ef750421428,DISK] 2023-07-12 22:13:38,723 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33679,DS-48f64913-d162-47aa-9fa4-b9900d3b76f3,DISK] 2023-07-12 22:13:38,730 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/WALs/jenkins-hbase4.apache.org,40411,1689200016125/jenkins-hbase4.apache.org%2C40411%2C1689200016125.meta.1689200018688.meta 2023-07-12 22:13:38,732 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34023,DS-3869eb7c-195a-4d0f-9bd7-35a493c00706,DISK], DatanodeInfoWithStorage[127.0.0.1:45613,DS-33138871-7520-4fde-8cea-4ef750421428,DISK], DatanodeInfoWithStorage[127.0.0.1:33679,DS-48f64913-d162-47aa-9fa4-b9900d3b76f3,DISK]] 2023-07-12 22:13:38,732 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-12 22:13:38,734 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-07-12 22:13:38,735 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 22:13:38,736 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-12 22:13:38,738 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-12 22:13:38,740 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-12 22:13:38,758 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-12 22:13:38,759 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 22:13:38,759 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-12 22:13:38,759 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-12 22:13:38,762 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-12 22:13:38,765 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/hbase/meta/1588230740/info 2023-07-12 22:13:38,766 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/hbase/meta/1588230740/info 2023-07-12 22:13:38,767 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-12 22:13:38,768 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 22:13:38,768 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-12 22:13:38,770 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/hbase/meta/1588230740/rep_barrier 2023-07-12 22:13:38,770 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/hbase/meta/1588230740/rep_barrier 2023-07-12 22:13:38,771 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-12 22:13:38,772 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 22:13:38,772 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-12 22:13:38,774 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/hbase/meta/1588230740/table 2023-07-12 22:13:38,774 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/hbase/meta/1588230740/table 2023-07-12 22:13:38,774 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-12 22:13:38,775 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 22:13:38,778 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/hbase/meta/1588230740 2023-07-12 22:13:38,781 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/hbase/meta/1588230740 2023-07-12 22:13:38,786 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 22:13:38,791 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-12 22:13:38,793 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61641630, jitterRate=-0.0814681351184845}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 22:13:38,797 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-12 22:13:38,813 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1689200018643 2023-07-12 22:13:38,841 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-12 22:13:38,842 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-12 22:13:38,844 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,40411,1689200016125, state=OPEN 2023-07-12 22:13:38,848 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-12 22:13:38,849 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-12 22:13:38,854 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-12 22:13:38,854 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,40411,1689200016125 in 451 msec 2023-07-12 22:13:38,861 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-12 22:13:38,861 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 710 msec 2023-07-12 22:13:38,868 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.3030 sec 2023-07-12 22:13:38,868 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1689200018868, completionTime=-1 2023-07-12 22:13:38,868 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-07-12 22:13:38,868 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-12 22:13:38,962 DEBUG [hconnection-0x407c7a8e-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 22:13:38,966 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56984, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 22:13:38,990 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-07-12 22:13:38,991 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689200078990 2023-07-12 22:13:38,991 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689200138991 2023-07-12 22:13:38,991 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 122 msec 2023-07-12 22:13:39,018 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43225,1689200014499-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 22:13:39,019 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43225,1689200014499-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-12 22:13:39,019 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43225,1689200014499-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-12 22:13:39,022 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:43225, period=300000, unit=MILLISECONDS is enabled. 2023-07-12 22:13:39,022 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-12 22:13:39,030 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-12 22:13:39,043 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-12 22:13:39,044 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-12 22:13:39,055 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-12 22:13:39,059 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 22:13:39,063 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 22:13:39,086 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/hbase/namespace/e4d70b8a3db9931e0f20d3426a310c90 2023-07-12 22:13:39,089 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/hbase/namespace/e4d70b8a3db9931e0f20d3426a310c90 empty. 2023-07-12 22:13:39,090 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/hbase/namespace/e4d70b8a3db9931e0f20d3426a310c90 2023-07-12 22:13:39,090 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-12 22:13:39,138 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-12 22:13:39,141 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => e4d70b8a3db9931e0f20d3426a310c90, NAME => 'hbase:namespace,,1689200019044.e4d70b8a3db9931e0f20d3426a310c90.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp 2023-07-12 22:13:39,162 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689200019044.e4d70b8a3db9931e0f20d3426a310c90.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 22:13:39,162 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing e4d70b8a3db9931e0f20d3426a310c90, disabling compactions & flushes 2023-07-12 22:13:39,162 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689200019044.e4d70b8a3db9931e0f20d3426a310c90. 2023-07-12 22:13:39,162 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689200019044.e4d70b8a3db9931e0f20d3426a310c90. 2023-07-12 22:13:39,162 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689200019044.e4d70b8a3db9931e0f20d3426a310c90. after waiting 0 ms 2023-07-12 22:13:39,162 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689200019044.e4d70b8a3db9931e0f20d3426a310c90. 2023-07-12 22:13:39,162 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689200019044.e4d70b8a3db9931e0f20d3426a310c90. 2023-07-12 22:13:39,162 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for e4d70b8a3db9931e0f20d3426a310c90: 2023-07-12 22:13:39,167 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 22:13:39,184 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1689200019044.e4d70b8a3db9931e0f20d3426a310c90.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689200019170"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689200019170"}]},"ts":"1689200019170"} 2023-07-12 22:13:39,213 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-12 22:13:39,215 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 22:13:39,219 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689200019215"}]},"ts":"1689200019215"} 2023-07-12 22:13:39,225 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-12 22:13:39,231 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-12 22:13:39,233 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 22:13:39,233 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 22:13:39,233 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-12 22:13:39,233 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 22:13:39,236 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=e4d70b8a3db9931e0f20d3426a310c90, ASSIGN}] 2023-07-12 22:13:39,244 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=e4d70b8a3db9931e0f20d3426a310c90, ASSIGN 2023-07-12 22:13:39,246 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=e4d70b8a3db9931e0f20d3426a310c90, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37349,1689200016037; forceNewPlan=false, retain=false 2023-07-12 22:13:39,399 INFO [jenkins-hbase4:43225] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-12 22:13:39,401 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=e4d70b8a3db9931e0f20d3426a310c90, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:13:39,401 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1689200019044.e4d70b8a3db9931e0f20d3426a310c90.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689200019400"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689200019400"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689200019400"}]},"ts":"1689200019400"} 2023-07-12 22:13:39,405 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure e4d70b8a3db9931e0f20d3426a310c90, server=jenkins-hbase4.apache.org,37349,1689200016037}] 2023-07-12 22:13:39,560 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:13:39,560 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-12 22:13:39,563 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34418, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-12 22:13:39,571 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1689200019044.e4d70b8a3db9931e0f20d3426a310c90. 2023-07-12 22:13:39,571 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e4d70b8a3db9931e0f20d3426a310c90, NAME => 'hbase:namespace,,1689200019044.e4d70b8a3db9931e0f20d3426a310c90.', STARTKEY => '', ENDKEY => ''} 2023-07-12 22:13:39,572 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1689200019044.e4d70b8a3db9931e0f20d3426a310c90. service=AccessControlService 2023-07-12 22:13:39,572 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 22:13:39,573 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace e4d70b8a3db9931e0f20d3426a310c90 2023-07-12 22:13:39,573 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689200019044.e4d70b8a3db9931e0f20d3426a310c90.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 22:13:39,573 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e4d70b8a3db9931e0f20d3426a310c90 2023-07-12 22:13:39,573 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e4d70b8a3db9931e0f20d3426a310c90 2023-07-12 22:13:39,575 INFO [StoreOpener-e4d70b8a3db9931e0f20d3426a310c90-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region e4d70b8a3db9931e0f20d3426a310c90 2023-07-12 22:13:39,578 DEBUG [StoreOpener-e4d70b8a3db9931e0f20d3426a310c90-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/hbase/namespace/e4d70b8a3db9931e0f20d3426a310c90/info 2023-07-12 22:13:39,578 DEBUG [StoreOpener-e4d70b8a3db9931e0f20d3426a310c90-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/hbase/namespace/e4d70b8a3db9931e0f20d3426a310c90/info 2023-07-12 22:13:39,578 INFO [StoreOpener-e4d70b8a3db9931e0f20d3426a310c90-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e4d70b8a3db9931e0f20d3426a310c90 columnFamilyName info 2023-07-12 22:13:39,579 INFO [StoreOpener-e4d70b8a3db9931e0f20d3426a310c90-1] regionserver.HStore(310): Store=e4d70b8a3db9931e0f20d3426a310c90/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 22:13:39,581 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/hbase/namespace/e4d70b8a3db9931e0f20d3426a310c90 2023-07-12 22:13:39,582 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/hbase/namespace/e4d70b8a3db9931e0f20d3426a310c90 2023-07-12 22:13:39,588 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e4d70b8a3db9931e0f20d3426a310c90 2023-07-12 22:13:39,592 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/hbase/namespace/e4d70b8a3db9931e0f20d3426a310c90/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 22:13:39,593 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e4d70b8a3db9931e0f20d3426a310c90; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68527330, jitterRate=0.02113679051399231}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 22:13:39,593 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e4d70b8a3db9931e0f20d3426a310c90: 2023-07-12 22:13:39,600 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1689200019044.e4d70b8a3db9931e0f20d3426a310c90., pid=6, masterSystemTime=1689200019560 2023-07-12 22:13:39,607 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1689200019044.e4d70b8a3db9931e0f20d3426a310c90. 2023-07-12 22:13:39,607 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1689200019044.e4d70b8a3db9931e0f20d3426a310c90. 2023-07-12 22:13:39,609 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=e4d70b8a3db9931e0f20d3426a310c90, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:13:39,609 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1689200019044.e4d70b8a3db9931e0f20d3426a310c90.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689200019608"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689200019608"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689200019608"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689200019608"}]},"ts":"1689200019608"} 2023-07-12 22:13:39,620 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-12 22:13:39,620 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure e4d70b8a3db9931e0f20d3426a310c90, server=jenkins-hbase4.apache.org,37349,1689200016037 in 208 msec 2023-07-12 22:13:39,663 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-12 22:13:39,663 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=e4d70b8a3db9931e0f20d3426a310c90, ASSIGN in 384 msec 2023-07-12 22:13:39,666 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 22:13:39,666 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689200019666"}]},"ts":"1689200019666"} 2023-07-12 22:13:39,669 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-12 22:13:39,675 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 22:13:39,679 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 630 msec 2023-07-12 22:13:39,759 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-12 22:13:39,761 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-12 22:13:39,761 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 22:13:39,784 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 22:13:39,787 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34428, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 22:13:39,801 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-12 22:13:39,828 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-12 22:13:39,835 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 43 msec 2023-07-12 22:13:39,845 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-12 22:13:39,856 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-12 22:13:39,875 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 16 msec 2023-07-12 22:13:39,886 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-12 22:13:39,889 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-12 22:13:39,891 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.624sec 2023-07-12 22:13:39,894 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-12 22:13:39,896 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-12 22:13:39,897 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-12 22:13:39,898 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43225,1689200014499-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-12 22:13:39,899 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43225,1689200014499-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-12 22:13:39,925 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-12 22:13:39,927 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-07-12 22:13:39,929 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 22:13:39,932 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 22:13:39,934 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-07-12 22:13:39,941 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/hbase/acl/6bafa9910cce283c65634e629ca8b487 2023-07-12 22:13:39,942 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/hbase/acl/6bafa9910cce283c65634e629ca8b487 empty. 2023-07-12 22:13:39,942 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-12 22:13:39,945 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/hbase/acl/6bafa9910cce283c65634e629ca8b487 2023-07-12 22:13:39,945 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-07-12 22:13:39,963 DEBUG [Listener at localhost/36933] zookeeper.ReadOnlyZKClient(139): Connect 0x67106910 to 127.0.0.1:62393 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 22:13:39,973 DEBUG [Listener at localhost/36933] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3f3fa874, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 22:13:39,989 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-07-12 22:13:39,996 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => 6bafa9910cce283c65634e629ca8b487, NAME => 'hbase:acl,,1689200019921.6bafa9910cce283c65634e629ca8b487.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp 2023-07-12 22:13:40,002 DEBUG [hconnection-0x6ea28f2d-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 22:13:40,019 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56988, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 22:13:40,035 INFO [Listener at localhost/36933] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,43225,1689200014499 2023-07-12 22:13:40,035 INFO [Listener at localhost/36933] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-07-12 22:13:40,035 INFO [Listener at localhost/36933] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/652e6e64-efb3-f860-57fa-f551f44ecb6b/test.cache.data in system properties and HBase conf 2023-07-12 22:13:40,035 INFO [Listener at localhost/36933] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/652e6e64-efb3-f860-57fa-f551f44ecb6b/hadoop.tmp.dir in system properties and HBase conf 2023-07-12 22:13:40,035 INFO [Listener at localhost/36933] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/652e6e64-efb3-f860-57fa-f551f44ecb6b/hadoop.log.dir in system properties and HBase conf 2023-07-12 22:13:40,035 INFO [Listener at localhost/36933] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/652e6e64-efb3-f860-57fa-f551f44ecb6b/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-12 22:13:40,035 INFO [Listener at localhost/36933] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/652e6e64-efb3-f860-57fa-f551f44ecb6b/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-12 22:13:40,035 INFO [Listener at localhost/36933] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-12 22:13:40,036 INFO [Listener at localhost/36933] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/652e6e64-efb3-f860-57fa-f551f44ecb6b/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-12 22:13:40,036 INFO [Listener at localhost/36933] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/652e6e64-efb3-f860-57fa-f551f44ecb6b/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-12 22:13:40,036 INFO [Listener at localhost/36933] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/652e6e64-efb3-f860-57fa-f551f44ecb6b/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-12 22:13:40,036 INFO [Listener at localhost/36933] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/652e6e64-efb3-f860-57fa-f551f44ecb6b/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-12 22:13:40,036 INFO [Listener at localhost/36933] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/652e6e64-efb3-f860-57fa-f551f44ecb6b/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-12 22:13:40,036 INFO [Listener at localhost/36933] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/652e6e64-efb3-f860-57fa-f551f44ecb6b/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-12 22:13:40,036 INFO [Listener at localhost/36933] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/652e6e64-efb3-f860-57fa-f551f44ecb6b/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-12 22:13:40,036 INFO [Listener at localhost/36933] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/652e6e64-efb3-f860-57fa-f551f44ecb6b/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-12 22:13:40,036 INFO [Listener at localhost/36933] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/652e6e64-efb3-f860-57fa-f551f44ecb6b/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-12 22:13:40,036 INFO [Listener at localhost/36933] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/652e6e64-efb3-f860-57fa-f551f44ecb6b/nfs.dump.dir in system properties and HBase conf 2023-07-12 22:13:40,037 INFO [Listener at localhost/36933] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/652e6e64-efb3-f860-57fa-f551f44ecb6b/java.io.tmpdir in system properties and HBase conf 2023-07-12 22:13:40,037 INFO [Listener at localhost/36933] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/652e6e64-efb3-f860-57fa-f551f44ecb6b/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-12 22:13:40,037 INFO [Listener at localhost/36933] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/652e6e64-efb3-f860-57fa-f551f44ecb6b/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-12 22:13:40,037 INFO [Listener at localhost/36933] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/652e6e64-efb3-f860-57fa-f551f44ecb6b/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-07-12 22:13:40,049 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-12 22:13:40,053 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689200019921.6bafa9910cce283c65634e629ca8b487.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 22:13:40,054 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing 6bafa9910cce283c65634e629ca8b487, disabling compactions & flushes 2023-07-12 22:13:40,054 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689200019921.6bafa9910cce283c65634e629ca8b487. 2023-07-12 22:13:40,054 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689200019921.6bafa9910cce283c65634e629ca8b487. 2023-07-12 22:13:40,054 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689200019921.6bafa9910cce283c65634e629ca8b487. after waiting 0 ms 2023-07-12 22:13:40,054 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689200019921.6bafa9910cce283c65634e629ca8b487. 2023-07-12 22:13:40,054 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1689200019921.6bafa9910cce283c65634e629ca8b487. 2023-07-12 22:13:40,054 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for 6bafa9910cce283c65634e629ca8b487: 2023-07-12 22:13:40,067 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 22:13:40,069 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1689200019921.6bafa9910cce283c65634e629ca8b487.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689200020068"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689200020068"}]},"ts":"1689200020068"} 2023-07-12 22:13:40,076 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-12 22:13:40,079 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 22:13:40,079 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689200020079"}]},"ts":"1689200020079"} 2023-07-12 22:13:40,084 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-07-12 22:13:40,090 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-12 22:13:40,092 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 22:13:40,092 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 22:13:40,093 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-12 22:13:40,093 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 22:13:40,093 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=6bafa9910cce283c65634e629ca8b487, ASSIGN}] 2023-07-12 22:13:40,104 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=6bafa9910cce283c65634e629ca8b487, ASSIGN 2023-07-12 22:13:40,106 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=6bafa9910cce283c65634e629ca8b487, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34497,1689200016186; forceNewPlan=false, retain=false 2023-07-12 22:13:40,250 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-12 22:13:40,256 INFO [jenkins-hbase4:43225] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-12 22:13:40,257 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=6bafa9910cce283c65634e629ca8b487, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:13:40,258 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1689200019921.6bafa9910cce283c65634e629ca8b487.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689200020257"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689200020257"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689200020257"}]},"ts":"1689200020257"} 2023-07-12 22:13:40,261 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 6bafa9910cce283c65634e629ca8b487, server=jenkins-hbase4.apache.org,34497,1689200016186}] 2023-07-12 22:13:40,416 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:13:40,416 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-12 22:13:40,418 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47608, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-12 22:13:40,425 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1689200019921.6bafa9910cce283c65634e629ca8b487. 2023-07-12 22:13:40,426 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6bafa9910cce283c65634e629ca8b487, NAME => 'hbase:acl,,1689200019921.6bafa9910cce283c65634e629ca8b487.', STARTKEY => '', ENDKEY => ''} 2023-07-12 22:13:40,426 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1689200019921.6bafa9910cce283c65634e629ca8b487. service=AccessControlService 2023-07-12 22:13:40,427 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 22:13:40,427 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl 6bafa9910cce283c65634e629ca8b487 2023-07-12 22:13:40,427 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689200019921.6bafa9910cce283c65634e629ca8b487.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 22:13:40,427 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 6bafa9910cce283c65634e629ca8b487 2023-07-12 22:13:40,427 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 6bafa9910cce283c65634e629ca8b487 2023-07-12 22:13:40,429 INFO [StoreOpener-6bafa9910cce283c65634e629ca8b487-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region 6bafa9910cce283c65634e629ca8b487 2023-07-12 22:13:40,433 DEBUG [StoreOpener-6bafa9910cce283c65634e629ca8b487-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/hbase/acl/6bafa9910cce283c65634e629ca8b487/l 2023-07-12 22:13:40,433 DEBUG [StoreOpener-6bafa9910cce283c65634e629ca8b487-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/hbase/acl/6bafa9910cce283c65634e629ca8b487/l 2023-07-12 22:13:40,434 INFO [StoreOpener-6bafa9910cce283c65634e629ca8b487-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6bafa9910cce283c65634e629ca8b487 columnFamilyName l 2023-07-12 22:13:40,435 INFO [StoreOpener-6bafa9910cce283c65634e629ca8b487-1] regionserver.HStore(310): Store=6bafa9910cce283c65634e629ca8b487/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 22:13:40,437 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/hbase/acl/6bafa9910cce283c65634e629ca8b487 2023-07-12 22:13:40,439 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/hbase/acl/6bafa9910cce283c65634e629ca8b487 2023-07-12 22:13:40,444 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 6bafa9910cce283c65634e629ca8b487 2023-07-12 22:13:40,449 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/hbase/acl/6bafa9910cce283c65634e629ca8b487/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 22:13:40,450 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 6bafa9910cce283c65634e629ca8b487; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71550834, jitterRate=0.06619051098823547}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 22:13:40,451 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 6bafa9910cce283c65634e629ca8b487: 2023-07-12 22:13:40,453 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1689200019921.6bafa9910cce283c65634e629ca8b487., pid=11, masterSystemTime=1689200020416 2023-07-12 22:13:40,462 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1689200019921.6bafa9910cce283c65634e629ca8b487. 2023-07-12 22:13:40,464 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1689200019921.6bafa9910cce283c65634e629ca8b487. 2023-07-12 22:13:40,465 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=6bafa9910cce283c65634e629ca8b487, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:13:40,465 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1689200019921.6bafa9910cce283c65634e629ca8b487.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689200020464"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689200020464"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689200020464"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689200020464"}]},"ts":"1689200020464"} 2023-07-12 22:13:40,475 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-07-12 22:13:40,475 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 6bafa9910cce283c65634e629ca8b487, server=jenkins-hbase4.apache.org,34497,1689200016186 in 208 msec 2023-07-12 22:13:40,481 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-07-12 22:13:40,481 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=6bafa9910cce283c65634e629ca8b487, ASSIGN in 382 msec 2023-07-12 22:13:40,482 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 22:13:40,483 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689200020482"}]},"ts":"1689200020482"} 2023-07-12 22:13:40,487 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-07-12 22:13:40,491 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 22:13:40,497 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 566 msec 2023-07-12 22:13:40,550 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-12 22:13:40,550 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-07-12 22:13:40,561 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-12 22:13:41,261 WARN [Thread-383] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 22:13:41,581 INFO [Thread-383] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 22:13:41,586 INFO [Thread-383] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/652e6e64-efb3-f860-57fa-f551f44ecb6b/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_40285_jobhistory____d83au4/webapp 2023-07-12 22:13:41,747 INFO [Thread-383] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-07-12 22:13:41,747 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-07-12 22:13:41,748 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-12 22:13:41,751 INFO [Thread-383] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-12 22:13:41,830 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-12 22:13:42,192 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-12 22:13:42,604 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-07-12 22:13:42,654 INFO [Thread-383] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:40285 2023-07-12 22:13:44,259 WARN [Listener at jenkins-hbase4.apache.org/44863] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 22:13:44,483 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-12 22:13:44,588 WARN [Listener at jenkins-hbase4.apache.org/44863] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-12 22:13:44,589 INFO [Listener at jenkins-hbase4.apache.org/44863] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 22:13:44,637 INFO [Listener at jenkins-hbase4.apache.org/44863] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/652e6e64-efb3-f860-57fa-f551f44ecb6b/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_35433_cluster____.cohfgu/webapp 2023-07-12 22:13:44,661 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-12 22:13:44,663 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-12 22:13:44,664 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-07-12 22:13:44,670 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 22:13:44,670 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-07-12 22:13:44,671 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 22:13:44,671 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-07-12 22:13:44,671 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-12 22:13:44,671 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-07-12 22:13:44,671 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 22:13:44,671 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-07-12 22:13:44,672 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-12 22:13:44,672 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-12 22:13:44,730 INFO [Listener at jenkins-hbase4.apache.org/44863] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-07-12 22:13:44,730 INFO [Listener at jenkins-hbase4.apache.org/44863] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-07-12 22:13:44,730 INFO [Listener at jenkins-hbase4.apache.org/44863] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-12 22:13:44,731 INFO [Listener at jenkins-hbase4.apache.org/44863] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-12 22:13:44,741 INFO [Listener at jenkins-hbase4.apache.org/44863] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-12 22:13:44,921 INFO [Listener at jenkins-hbase4.apache.org/44863] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-12 22:13:45,023 INFO [Listener at jenkins-hbase4.apache.org/44863] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-12 22:13:45,030 INFO [Listener at jenkins-hbase4.apache.org/44863] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:35433 2023-07-12 22:13:45,377 WARN [Listener at jenkins-hbase4.apache.org/42257] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 22:13:45,402 WARN [Listener at jenkins-hbase4.apache.org/42257] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-12 22:13:45,403 INFO [Listener at jenkins-hbase4.apache.org/42257] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 22:13:45,414 INFO [Listener at jenkins-hbase4.apache.org/42257] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/652e6e64-efb3-f860-57fa-f551f44ecb6b/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_41337_node____oyf6ns/webapp 2023-07-12 22:13:45,466 INFO [Listener at jenkins-hbase4.apache.org/42257] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-12 22:13:45,466 INFO [Listener at jenkins-hbase4.apache.org/42257] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-12 22:13:45,466 INFO [Listener at jenkins-hbase4.apache.org/42257] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-12 22:13:45,466 INFO [Listener at jenkins-hbase4.apache.org/42257] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-12 22:13:45,474 INFO [Listener at jenkins-hbase4.apache.org/42257] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-12 22:13:45,492 INFO [Listener at jenkins-hbase4.apache.org/42257] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-12 22:13:45,562 INFO [Listener at jenkins-hbase4.apache.org/42257] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-12 22:13:45,575 INFO [Listener at jenkins-hbase4.apache.org/42257] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:41337 2023-07-12 22:13:45,711 WARN [Listener at jenkins-hbase4.apache.org/41531] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 22:13:45,717 WARN [Listener at jenkins-hbase4.apache.org/41531] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-12 22:13:45,717 INFO [Listener at jenkins-hbase4.apache.org/41531] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 22:13:45,726 INFO [Listener at jenkins-hbase4.apache.org/41531] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/652e6e64-efb3-f860-57fa-f551f44ecb6b/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_35759_node____.4qww21/webapp 2023-07-12 22:13:45,808 INFO [Listener at jenkins-hbase4.apache.org/41531] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-12 22:13:45,808 INFO [Listener at jenkins-hbase4.apache.org/41531] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-12 22:13:45,808 INFO [Listener at jenkins-hbase4.apache.org/41531] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-12 22:13:45,809 INFO [Listener at jenkins-hbase4.apache.org/41531] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-12 22:13:45,820 INFO [Listener at jenkins-hbase4.apache.org/41531] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-12 22:13:45,837 INFO [Listener at jenkins-hbase4.apache.org/41531] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-12 22:13:45,911 INFO [Listener at jenkins-hbase4.apache.org/41531] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-12 22:13:45,921 INFO [Listener at jenkins-hbase4.apache.org/41531] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:35759 2023-07-12 22:13:45,969 INFO [Listener at jenkins-hbase4.apache.org/41531] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-07-12 22:13:45,971 INFO [Listener at jenkins-hbase4.apache.org/41531] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 22:13:46,043 INFO [Listener at jenkins-hbase4.apache.org/41531] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=708, OpenFileDescriptor=900, MaxFileDescriptor=60000, SystemLoadAverage=294, ProcessCount=174, AvailableMemoryMB=6547 2023-07-12 22:13:46,043 WARN [Listener at jenkins-hbase4.apache.org/41531] hbase.ResourceChecker(130): Thread=708 is superior to 500 2023-07-12 22:13:46,059 DEBUG [Listener at jenkins-hbase4.apache.org/41531] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-12 22:13:46,064 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51996, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-12 22:13:46,071 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-12 22:13:46,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-07-12 22:13:46,076 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 22:13:46,077 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-07-12 22:13:46,078 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 22:13:46,078 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-12 22:13:46,082 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testExportWithTargetName/4d68d9664cc96c9b019a44997df4ff6d 2023-07-12 22:13:46,082 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testExportWithTargetName/8748574fb38143a2a5d3e24f437a695b 2023-07-12 22:13:46,085 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testExportWithTargetName/4d68d9664cc96c9b019a44997df4ff6d empty. 2023-07-12 22:13:46,085 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testExportWithTargetName/8748574fb38143a2a5d3e24f437a695b empty. 2023-07-12 22:13:46,086 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testExportWithTargetName/4d68d9664cc96c9b019a44997df4ff6d 2023-07-12 22:13:46,086 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testExportWithTargetName/8748574fb38143a2a5d3e24f437a695b 2023-07-12 22:13:46,086 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-12 22:13:46,124 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-07-12 22:13:46,126 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => 4d68d9664cc96c9b019a44997df4ff6d, NAME => 'testtb-testExportWithTargetName,,1689200026071.4d68d9664cc96c9b019a44997df4ff6d.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp 2023-07-12 22:13:46,127 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => 8748574fb38143a2a5d3e24f437a695b, NAME => 'testtb-testExportWithTargetName,1,1689200026071.8748574fb38143a2a5d3e24f437a695b.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp 2023-07-12 22:13:46,180 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689200026071.4d68d9664cc96c9b019a44997df4ff6d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 22:13:46,184 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing 4d68d9664cc96c9b019a44997df4ff6d, disabling compactions & flushes 2023-07-12 22:13:46,184 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689200026071.4d68d9664cc96c9b019a44997df4ff6d. 2023-07-12 22:13:46,184 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689200026071.4d68d9664cc96c9b019a44997df4ff6d. 2023-07-12 22:13:46,184 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689200026071.4d68d9664cc96c9b019a44997df4ff6d. after waiting 0 ms 2023-07-12 22:13:46,184 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689200026071.4d68d9664cc96c9b019a44997df4ff6d. 2023-07-12 22:13:46,184 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689200026071.4d68d9664cc96c9b019a44997df4ff6d. 2023-07-12 22:13:46,184 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689200026071.8748574fb38143a2a5d3e24f437a695b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 22:13:46,184 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for 4d68d9664cc96c9b019a44997df4ff6d: 2023-07-12 22:13:46,185 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing 8748574fb38143a2a5d3e24f437a695b, disabling compactions & flushes 2023-07-12 22:13:46,185 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689200026071.8748574fb38143a2a5d3e24f437a695b. 2023-07-12 22:13:46,185 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689200026071.8748574fb38143a2a5d3e24f437a695b. 2023-07-12 22:13:46,185 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689200026071.8748574fb38143a2a5d3e24f437a695b. after waiting 0 ms 2023-07-12 22:13:46,185 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689200026071.8748574fb38143a2a5d3e24f437a695b. 2023-07-12 22:13:46,185 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-12 22:13:46,185 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689200026071.8748574fb38143a2a5d3e24f437a695b. 2023-07-12 22:13:46,185 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for 8748574fb38143a2a5d3e24f437a695b: 2023-07-12 22:13:46,190 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 22:13:46,192 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689200026071.4d68d9664cc96c9b019a44997df4ff6d.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689200026191"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689200026191"}]},"ts":"1689200026191"} 2023-07-12 22:13:46,192 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689200026071.8748574fb38143a2a5d3e24f437a695b.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689200026191"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689200026191"}]},"ts":"1689200026191"} 2023-07-12 22:13:46,246 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-12 22:13:46,249 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 22:13:46,249 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689200026249"}]},"ts":"1689200026249"} 2023-07-12 22:13:46,252 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-07-12 22:13:46,259 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-12 22:13:46,261 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 22:13:46,261 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 22:13:46,261 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-12 22:13:46,261 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 22:13:46,262 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=4d68d9664cc96c9b019a44997df4ff6d, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=8748574fb38143a2a5d3e24f437a695b, ASSIGN}] 2023-07-12 22:13:46,266 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=8748574fb38143a2a5d3e24f437a695b, ASSIGN 2023-07-12 22:13:46,266 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=4d68d9664cc96c9b019a44997df4ff6d, ASSIGN 2023-07-12 22:13:46,268 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=8748574fb38143a2a5d3e24f437a695b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34497,1689200016186; forceNewPlan=false, retain=false 2023-07-12 22:13:46,268 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=4d68d9664cc96c9b019a44997df4ff6d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40411,1689200016125; forceNewPlan=false, retain=false 2023-07-12 22:13:46,390 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-12 22:13:46,418 INFO [jenkins-hbase4:43225] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-12 22:13:46,421 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=4d68d9664cc96c9b019a44997df4ff6d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:13:46,421 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=8748574fb38143a2a5d3e24f437a695b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:13:46,421 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689200026071.4d68d9664cc96c9b019a44997df4ff6d.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689200026421"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689200026421"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689200026421"}]},"ts":"1689200026421"} 2023-07-12 22:13:46,421 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689200026071.8748574fb38143a2a5d3e24f437a695b.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689200026421"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689200026421"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689200026421"}]},"ts":"1689200026421"} 2023-07-12 22:13:46,424 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE; OpenRegionProcedure 8748574fb38143a2a5d3e24f437a695b, server=jenkins-hbase4.apache.org,34497,1689200016186}] 2023-07-12 22:13:46,426 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=13, state=RUNNABLE; OpenRegionProcedure 4d68d9664cc96c9b019a44997df4ff6d, server=jenkins-hbase4.apache.org,40411,1689200016125}] 2023-07-12 22:13:46,584 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1689200026071.8748574fb38143a2a5d3e24f437a695b. 2023-07-12 22:13:46,584 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8748574fb38143a2a5d3e24f437a695b, NAME => 'testtb-testExportWithTargetName,1,1689200026071.8748574fb38143a2a5d3e24f437a695b.', STARTKEY => '1', ENDKEY => ''} 2023-07-12 22:13:46,584 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1689200026071.8748574fb38143a2a5d3e24f437a695b. service=AccessControlService 2023-07-12 22:13:46,584 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 22:13:46,585 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 8748574fb38143a2a5d3e24f437a695b 2023-07-12 22:13:46,585 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689200026071.8748574fb38143a2a5d3e24f437a695b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 22:13:46,585 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 8748574fb38143a2a5d3e24f437a695b 2023-07-12 22:13:46,585 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 8748574fb38143a2a5d3e24f437a695b 2023-07-12 22:13:46,588 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1689200026071.4d68d9664cc96c9b019a44997df4ff6d. 2023-07-12 22:13:46,588 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4d68d9664cc96c9b019a44997df4ff6d, NAME => 'testtb-testExportWithTargetName,,1689200026071.4d68d9664cc96c9b019a44997df4ff6d.', STARTKEY => '', ENDKEY => '1'} 2023-07-12 22:13:46,589 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1689200026071.4d68d9664cc96c9b019a44997df4ff6d. service=AccessControlService 2023-07-12 22:13:46,589 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 22:13:46,589 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 4d68d9664cc96c9b019a44997df4ff6d 2023-07-12 22:13:46,589 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689200026071.4d68d9664cc96c9b019a44997df4ff6d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 22:13:46,589 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 4d68d9664cc96c9b019a44997df4ff6d 2023-07-12 22:13:46,589 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 4d68d9664cc96c9b019a44997df4ff6d 2023-07-12 22:13:46,592 INFO [StoreOpener-8748574fb38143a2a5d3e24f437a695b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 8748574fb38143a2a5d3e24f437a695b 2023-07-12 22:13:46,592 INFO [StoreOpener-4d68d9664cc96c9b019a44997df4ff6d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 4d68d9664cc96c9b019a44997df4ff6d 2023-07-12 22:13:46,594 DEBUG [StoreOpener-8748574fb38143a2a5d3e24f437a695b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testExportWithTargetName/8748574fb38143a2a5d3e24f437a695b/cf 2023-07-12 22:13:46,594 DEBUG [StoreOpener-4d68d9664cc96c9b019a44997df4ff6d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testExportWithTargetName/4d68d9664cc96c9b019a44997df4ff6d/cf 2023-07-12 22:13:46,595 DEBUG [StoreOpener-8748574fb38143a2a5d3e24f437a695b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testExportWithTargetName/8748574fb38143a2a5d3e24f437a695b/cf 2023-07-12 22:13:46,595 DEBUG [StoreOpener-4d68d9664cc96c9b019a44997df4ff6d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testExportWithTargetName/4d68d9664cc96c9b019a44997df4ff6d/cf 2023-07-12 22:13:46,598 INFO [StoreOpener-8748574fb38143a2a5d3e24f437a695b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8748574fb38143a2a5d3e24f437a695b columnFamilyName cf 2023-07-12 22:13:46,598 INFO [StoreOpener-4d68d9664cc96c9b019a44997df4ff6d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4d68d9664cc96c9b019a44997df4ff6d columnFamilyName cf 2023-07-12 22:13:46,601 INFO [StoreOpener-4d68d9664cc96c9b019a44997df4ff6d-1] regionserver.HStore(310): Store=4d68d9664cc96c9b019a44997df4ff6d/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 22:13:46,601 INFO [StoreOpener-8748574fb38143a2a5d3e24f437a695b-1] regionserver.HStore(310): Store=8748574fb38143a2a5d3e24f437a695b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 22:13:46,604 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testExportWithTargetName/4d68d9664cc96c9b019a44997df4ff6d 2023-07-12 22:13:46,605 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testExportWithTargetName/8748574fb38143a2a5d3e24f437a695b 2023-07-12 22:13:46,605 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testExportWithTargetName/4d68d9664cc96c9b019a44997df4ff6d 2023-07-12 22:13:46,606 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testExportWithTargetName/8748574fb38143a2a5d3e24f437a695b 2023-07-12 22:13:46,610 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 4d68d9664cc96c9b019a44997df4ff6d 2023-07-12 22:13:46,610 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 8748574fb38143a2a5d3e24f437a695b 2023-07-12 22:13:46,613 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testExportWithTargetName/8748574fb38143a2a5d3e24f437a695b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 22:13:46,614 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testExportWithTargetName/4d68d9664cc96c9b019a44997df4ff6d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 22:13:46,614 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 8748574fb38143a2a5d3e24f437a695b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74582990, jitterRate=0.11137315630912781}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 22:13:46,614 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 8748574fb38143a2a5d3e24f437a695b: 2023-07-12 22:13:46,615 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 4d68d9664cc96c9b019a44997df4ff6d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73696960, jitterRate=0.09817028045654297}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 22:13:46,615 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 4d68d9664cc96c9b019a44997df4ff6d: 2023-07-12 22:13:46,616 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1689200026071.8748574fb38143a2a5d3e24f437a695b., pid=15, masterSystemTime=1689200026577 2023-07-12 22:13:46,616 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1689200026071.4d68d9664cc96c9b019a44997df4ff6d., pid=16, masterSystemTime=1689200026579 2023-07-12 22:13:46,618 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1689200026071.8748574fb38143a2a5d3e24f437a695b. 2023-07-12 22:13:46,618 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1689200026071.8748574fb38143a2a5d3e24f437a695b. 2023-07-12 22:13:46,619 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=8748574fb38143a2a5d3e24f437a695b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:13:46,619 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1689200026071.8748574fb38143a2a5d3e24f437a695b.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689200026619"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689200026619"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689200026619"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689200026619"}]},"ts":"1689200026619"} 2023-07-12 22:13:46,620 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1689200026071.4d68d9664cc96c9b019a44997df4ff6d. 2023-07-12 22:13:46,620 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1689200026071.4d68d9664cc96c9b019a44997df4ff6d. 2023-07-12 22:13:46,620 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=4d68d9664cc96c9b019a44997df4ff6d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:13:46,624 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1689200026071.4d68d9664cc96c9b019a44997df4ff6d.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689200026620"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689200026620"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689200026620"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689200026620"}]},"ts":"1689200026620"} 2023-07-12 22:13:46,628 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=14 2023-07-12 22:13:46,629 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=14, state=SUCCESS; OpenRegionProcedure 8748574fb38143a2a5d3e24f437a695b, server=jenkins-hbase4.apache.org,34497,1689200016186 in 201 msec 2023-07-12 22:13:46,631 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=13 2023-07-12 22:13:46,632 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=8748574fb38143a2a5d3e24f437a695b, ASSIGN in 367 msec 2023-07-12 22:13:46,632 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=13, state=SUCCESS; OpenRegionProcedure 4d68d9664cc96c9b019a44997df4ff6d, server=jenkins-hbase4.apache.org,40411,1689200016125 in 201 msec 2023-07-12 22:13:46,635 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=13, resume processing ppid=12 2023-07-12 22:13:46,635 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=4d68d9664cc96c9b019a44997df4ff6d, ASSIGN in 370 msec 2023-07-12 22:13:46,636 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 22:13:46,636 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689200026636"}]},"ts":"1689200026636"} 2023-07-12 22:13:46,638 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-07-12 22:13:46,642 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 22:13:46,647 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-07-12 22:13:46,653 DEBUG [PEWorker-5] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 22:13:46,656 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47614, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 22:13:46,660 DEBUG [hconnection-0x7623e369-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 22:13:46,663 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49974, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=ClientService 2023-07-12 22:13:46,672 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34497] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-12 22:13:46,692 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-12 22:13:46,702 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-12 22:13:46,702 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-12 22:13:46,702 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-12 22:13:46,702 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-12 22:13:46,703 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 22:13:46,711 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-12 22:13:46,711 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-12 22:13:46,711 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-12 22:13:46,711 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-12 22:13:46,715 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 640 msec 2023-07-12 22:13:47,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-12 22:13:47,194 INFO [Listener at jenkins-hbase4.apache.org/41531] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-07-12 22:13:47,199 DEBUG [Listener at jenkins-hbase4.apache.org/41531] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-12 22:13:47,200 DEBUG [Listener at jenkins-hbase4.apache.org/41531] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1689200026071.4d68d9664cc96c9b019a44997df4ff6d. 2023-07-12 22:13:47,203 INFO [Listener at jenkins-hbase4.apache.org/41531] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 22:13:47,231 DEBUG [hconnection-0x6ea28f2d-shared-pool-5] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 22:13:47,236 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47618, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 22:13:47,250 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-12 22:13:47,250 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689200027250 (current time:1689200027250). 2023-07-12 22:13:47,250 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 22:13:47,251 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] zookeeper.ReadOnlyZKClient(139): Connect 0x2adf4d06 to 127.0.0.1:62393 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 22:13:47,257 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@40695196, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 22:13:47,259 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 22:13:47,262 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49986, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 22:13:47,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2adf4d06 to 127.0.0.1:62393 2023-07-12 22:13:47,264 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 22:13:47,265 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] zookeeper.ReadOnlyZKClient(139): Connect 0x6cee61e3 to 127.0.0.1:62393 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 22:13:47,271 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@64b6d2a2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 22:13:47,272 DEBUG [hconnection-0x1ef397e3-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 22:13:47,273 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49996, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 22:13:47,277 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 22:13:47,280 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47624, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 22:13:47,281 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6cee61e3 to 127.0.0.1:62393 2023-07-12 22:13:47,281 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 22:13:47,281 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-12 22:13:47,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 22:13:47,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-12 22:13:47,333 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] procedure2.ProcedureExecutor(1029): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-12 22:13:47,335 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-12 22:13:47,336 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689200627336 2023-07-12 22:13:47,336 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-12 22:13:47,336 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-12 22:13:47,339 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-12 22:13:47,342 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-12 22:13:47,343 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 14 msec 2023-07-12 22:13:47,344 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-12 22:13:47,345 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689200627345 2023-07-12 22:13:47,347 DEBUG [Listener at jenkins-hbase4.apache.org/41531] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 22:13:47,347 DEBUG [Listener at jenkins-hbase4.apache.org/41531] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 22:13:47,361 WARN [DataStreamer for file /user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName/.snapshotinfo] hdfs.DataStreamer(982): Caught exception java.lang.InterruptedException at java.lang.Object.wait(Native Method) at java.lang.Thread.join(Thread.java:1257) at java.lang.Thread.join(Thread.java:1331) at org.apache.hadoop.hdfs.DataStreamer.closeResponder(DataStreamer.java:980) at org.apache.hadoop.hdfs.DataStreamer.endBlock(DataStreamer.java:630) at org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:807) 2023-07-12 22:13:47,371 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:47,371 INFO [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-07-12 22:13:47,372 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 22:13:47,372 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-07-12 22:13:47,372 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-12 22:13:47,373 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:47,373 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:47,378 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:13:47,378 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:13:47,378 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:13:47,378 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:13:47,378 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:13:47,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:13:47,379 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:13:47,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:13:47,378 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:13:47,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:13:47,379 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:13:47,379 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:13:47,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:47,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:47,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:47,379 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:13:47,379 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 22:13:47,380 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:47,380 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:47,380 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:47,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-12 22:13:47,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:47,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-12 22:13:47,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-12 22:13:47,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:47,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:47,382 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-12 22:13:47,382 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-12 22:13:47,382 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-12 22:13:47,384 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:47,384 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:47,384 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:47,384 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-12 22:13:47,384 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 22:13:47,384 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-12 22:13:47,385 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-12 22:13:47,385 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 22:13:47,385 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-12 22:13:47,385 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 22:13:47,386 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-12 22:13:47,387 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-12 22:13:47,386 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-12 22:13:47,387 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37349,1689200016037' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-12 22:13:47,387 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-12 22:13:47,387 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-12 22:13:47,387 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40411,1689200016125' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-12 22:13:47,387 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34497,1689200016186' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-12 22:13:47,389 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:47,389 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:13:47,389 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:47,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:13:47,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 22:13:47,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 22:13:47,390 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:47,390 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:47,390 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:13:47,390 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 22:13:47,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 22:13:47,390 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:47,391 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 22:13:47,394 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:47,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 22:13:47,394 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 22:13:47,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:47,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:13:47,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:13:47,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:13:47,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 22:13:47,398 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40411,1689200016125' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-12 22:13:47,398 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@47f98828[Count = 1] remaining members to acquire global barrier 2023-07-12 22:13:47,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:13:47,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 22:13:47,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 22:13:47,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 22:13:47,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 22:13:47,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:47,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:13:47,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:13:47,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:13:47,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 22:13:47,400 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34497,1689200016186' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-12 22:13:47,400 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@47f98828[Count = 0] remaining members to acquire global barrier 2023-07-12 22:13:47,400 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-12 22:13:47,400 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:47,403 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:47,403 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:47,403 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:47,403 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:47,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:47,403 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:47,403 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-12 22:13:47,403 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:13:47,403 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:47,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:47,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:47,403 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-12 22:13:47,403 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-12 22:13:47,403 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-12 22:13:47,403 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:13:47,403 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,37349,1689200016037' in zk 2023-07-12 22:13:47,404 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 22:13:47,404 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 22:13:47,404 DEBUG [rs(jenkins-hbase4.apache.org,40411,1689200016125)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689200026071.4d68d9664cc96c9b019a44997df4ff6d. 2023-07-12 22:13:47,404 DEBUG [rs(jenkins-hbase4.apache.org,34497,1689200016186)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689200026071.8748574fb38143a2a5d3e24f437a695b. 2023-07-12 22:13:47,404 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 22:13:47,404 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 22:13:47,405 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 22:13:47,405 DEBUG [rs(jenkins-hbase4.apache.org,40411,1689200016125)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689200026071.4d68d9664cc96c9b019a44997df4ff6d. started... 2023-07-12 22:13:47,405 DEBUG [rs(jenkins-hbase4.apache.org,34497,1689200016186)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689200026071.8748574fb38143a2a5d3e24f437a695b. started... 2023-07-12 22:13:47,407 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-12 22:13:47,407 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 22:13:47,408 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-12 22:13:47,409 DEBUG [rs(jenkins-hbase4.apache.org,40411,1689200016125)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4d68d9664cc96c9b019a44997df4ff6d: 2023-07-12 22:13:47,409 DEBUG [rs(jenkins-hbase4.apache.org,34497,1689200016186)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8748574fb38143a2a5d3e24f437a695b: 2023-07-12 22:13:47,410 DEBUG [rs(jenkins-hbase4.apache.org,40411,1689200016125)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689200026071.4d68d9664cc96c9b019a44997df4ff6d.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:47,410 DEBUG [rs(jenkins-hbase4.apache.org,34497,1689200016186)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689200026071.8748574fb38143a2a5d3e24f437a695b.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:47,416 DEBUG [rs(jenkins-hbase4.apache.org,40411,1689200016125)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 22:13:47,416 DEBUG [rs(jenkins-hbase4.apache.org,34497,1689200016186)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 22:13:47,419 DEBUG [rs(jenkins-hbase4.apache.org,40411,1689200016125)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 22:13:47,419 DEBUG [rs(jenkins-hbase4.apache.org,34497,1689200016186)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 22:13:47,445 DEBUG [rs(jenkins-hbase4.apache.org,34497,1689200016186)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689200026071.8748574fb38143a2a5d3e24f437a695b. completed. 2023-07-12 22:13:47,446 DEBUG [rs(jenkins-hbase4.apache.org,40411,1689200016125)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689200026071.4d68d9664cc96c9b019a44997df4ff6d. completed. 2023-07-12 22:13:47,446 DEBUG [rs(jenkins-hbase4.apache.org,34497,1689200016186)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689200026071.8748574fb38143a2a5d3e24f437a695b. 2023-07-12 22:13:47,446 DEBUG [rs(jenkins-hbase4.apache.org,40411,1689200016125)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689200026071.4d68d9664cc96c9b019a44997df4ff6d. 2023-07-12 22:13:47,446 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 22:13:47,446 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 22:13:47,446 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 22:13:47,446 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 22:13:47,446 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:13:47,447 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:13:47,447 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-12 22:13:47,447 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-12 22:13:47,447 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,40411,1689200016125' in zk 2023-07-12 22:13:47,447 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,34497,1689200016186' in zk 2023-07-12 22:13:47,447 DEBUG [Listener at jenkins-hbase4.apache.org/41531] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 22:13:47,449 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:13:47,449 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-12 22:13:47,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:13:47,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 22:13:47,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 22:13:47,449 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 22:13:47,449 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-12 22:13:47,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-12 22:13:47,453 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-12 22:13:47,453 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-12 22:13:47,453 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:13:47,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 22:13:47,453 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 22:13:47,453 DEBUG [Listener at jenkins-hbase4.apache.org/41531] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 22:13:47,453 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-12 22:13:47,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 22:13:47,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:47,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:13:47,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:13:47,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:13:47,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 22:13:47,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:47,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:13:47,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:13:47,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:13:47,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,40411,1689200016125': 2023-07-12 22:13:47,459 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40411,1689200016125' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-12 22:13:47,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:13:47,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 22:13:47,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 22:13:47,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 22:13:47,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 22:13:47,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:47,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:13:47,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:13:47,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:13:47,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 22:13:47,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:47,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:13:47,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:13:47,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:13:47,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,34497,1689200016186': 2023-07-12 22:13:47,464 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34497,1689200016186' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-12 22:13:47,464 INFO [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-07-12 22:13:47,464 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 22:13:47,464 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 22:13:47,464 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:47,464 INFO [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 22:13:47,468 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:47,468 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:47,468 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:13:47,468 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:47,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:47,468 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:47,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 22:13:47,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 22:13:47,468 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:47,468 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:47,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:47,469 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:47,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:47,468 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:13:47,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:47,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 22:13:47,469 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:13:47,468 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:13:47,470 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:13:47,470 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:13:47,470 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:13:47,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:13:47,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:13:47,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:13:47,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:47,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:47,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:47,471 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:13:47,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 22:13:47,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:47,471 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:13:47,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:47,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:13:47,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:13:47,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:13:47,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 22:13:47,474 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:13:47,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:47,474 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:13:47,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:13:47,474 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:13:47,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:13:47,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:13:47,488 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:13:47,488 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:13:47,489 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:13:47,489 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:13:47,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:13:47,489 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:13:47,489 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:13:47,489 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:13:47,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:13:47,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:13:47,489 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:13:47,489 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:13:47,489 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:13:47,489 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:47,489 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:13:47,489 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:13:47,489 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 22:13:47,489 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:13:47,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:13:47,489 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:47,489 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:47,491 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-07-12 22:13:47,491 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:13:47,491 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:13:47,491 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:47,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:13:47,491 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:13:47,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:13:47,491 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:47,491 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:13:47,491 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:13:47,491 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:47,491 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:47,491 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-12 22:13:47,493 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-12 22:13:47,524 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:47,527 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:47,593 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:47,643 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-12 22:13:47,643 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:47,643 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:47,644 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689200027336Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1689200027524 (+188 ms)Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1689200027524Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1689200027525 (+1 ms)Writing data manifest for emptySnaptb0-testExportWithTargetName at 1689200027541 (+16 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1689200027580 (+39 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689200027643 (+63 ms) 2023-07-12 22:13:47,646 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-12 22:13:47,648 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 308 msec 2023-07-12 22:13:47,654 DEBUG [Listener at jenkins-hbase4.apache.org/41531] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 22:13:47,656 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-12 22:13:47,656 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 22:13:47,670 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40411] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1689200026071.4d68d9664cc96c9b019a44997df4ff6d. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 22:13:47,672 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34497] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1689200026071.8748574fb38143a2a5d3e24f437a695b. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 22:13:47,678 DEBUG [Listener at jenkins-hbase4.apache.org/41531] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-12 22:13:47,678 DEBUG [Listener at jenkins-hbase4.apache.org/41531] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1689200026071.4d68d9664cc96c9b019a44997df4ff6d. 2023-07-12 22:13:47,679 INFO [Listener at jenkins-hbase4.apache.org/41531] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 22:13:47,693 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-12 22:13:47,693 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689200027693 (current time:1689200027693). 2023-07-12 22:13:47,693 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 22:13:47,693 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] zookeeper.ReadOnlyZKClient(139): Connect 0x328c07e2 to 127.0.0.1:62393 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 22:13:47,700 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@30c6f440, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 22:13:47,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 22:13:47,704 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50004, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 22:13:47,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x328c07e2 to 127.0.0.1:62393 2023-07-12 22:13:47,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 22:13:47,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] zookeeper.ReadOnlyZKClient(139): Connect 0x67ee2e6a to 127.0.0.1:62393 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 22:13:47,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@358f8662, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 22:13:47,712 DEBUG [hconnection-0x326c0067-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 22:13:47,714 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50006, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 22:13:47,718 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 22:13:47,719 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47632, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 22:13:47,720 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x67ee2e6a to 127.0.0.1:62393 2023-07-12 22:13:47,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 22:13:47,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-12 22:13:47,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 22:13:47,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-12 22:13:47,725 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-12 22:13:47,726 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-12 22:13:47,727 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689200627727 2023-07-12 22:13:47,727 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-12 22:13:47,727 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-12 22:13:47,728 DEBUG [Listener at jenkins-hbase4.apache.org/41531] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 22:13:47,728 DEBUG [Listener at jenkins-hbase4.apache.org/41531] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 22:13:47,730 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-12 22:13:47,730 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-12 22:13:47,732 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 6 msec 2023-07-12 22:13:47,732 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-12 22:13:47,733 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689200627733 2023-07-12 22:13:47,752 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-07-12 22:13:47,752 INFO [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-07-12 22:13:47,752 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 22:13:47,753 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-07-12 22:13:47,753 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-12 22:13:47,754 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 22:13:47,754 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-12 22:13:47,755 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:13:47,755 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:13:47,755 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:13:47,755 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:13:47,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:13:47,755 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:13:47,755 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:13:47,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:13:47,756 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:13:47,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:13:47,756 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:13:47,756 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:13:47,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-12 22:13:47,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-12 22:13:47,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-12 22:13:47,757 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 22:13:47,757 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 22:13:47,757 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 22:13:47,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-12 22:13:47,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-12 22:13:47,758 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:13:47,758 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 22:13:47,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-12 22:13:47,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-12 22:13:47,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-12 22:13:47,758 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-12 22:13:47,758 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-12 22:13:47,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-12 22:13:47,759 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-12 22:13:47,760 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-12 22:13:47,760 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-12 22:13:47,760 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 22:13:47,761 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-12 22:13:47,761 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-12 22:13:47,761 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40411,1689200016125' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-12 22:13:47,763 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-12 22:13:47,763 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-12 22:13:47,763 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 22:13:47,764 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-12 22:13:47,764 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-12 22:13:47,764 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-12 22:13:47,764 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37349,1689200016037' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-12 22:13:47,764 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-12 22:13:47,764 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 22:13:47,765 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-12 22:13:47,765 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:13:47,765 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 22:13:47,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:13:47,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 22:13:47,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 22:13:47,765 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-12 22:13:47,765 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34497,1689200016186' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-12 22:13:47,765 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 22:13:47,765 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 22:13:47,766 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 22:13:47,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 22:13:47,767 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 22:13:47,767 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 22:13:47,768 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:13:47,768 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 22:13:47,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 22:13:47,769 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 22:13:47,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-12 22:13:47,769 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 22:13:47,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:13:47,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:13:47,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:13:47,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 22:13:47,771 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40411,1689200016125' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-12 22:13:47,771 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2e91cc29[Count = 1] remaining members to acquire global barrier 2023-07-12 22:13:47,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:13:47,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 22:13:47,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 22:13:47,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 22:13:47,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 22:13:47,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-12 22:13:47,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:13:47,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:13:47,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:13:47,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 22:13:47,775 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34497,1689200016186' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-12 22:13:47,775 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2e91cc29[Count = 0] remaining members to acquire global barrier 2023-07-12 22:13:47,775 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-12 22:13:47,775 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 22:13:47,779 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 22:13:47,779 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 22:13:47,779 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 22:13:47,779 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 22:13:47,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 22:13:47,780 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 22:13:47,780 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 22:13:47,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 22:13:47,780 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-12 22:13:47,780 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:13:47,780 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-12 22:13:47,780 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-12 22:13:47,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 22:13:47,780 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 22:13:47,780 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-12 22:13:47,780 DEBUG [rs(jenkins-hbase4.apache.org,40411,1689200016125)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689200026071.4d68d9664cc96c9b019a44997df4ff6d. 2023-07-12 22:13:47,780 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,37349,1689200016037' in zk 2023-07-12 22:13:47,780 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 22:13:47,780 DEBUG [rs(jenkins-hbase4.apache.org,34497,1689200016186)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689200026071.8748574fb38143a2a5d3e24f437a695b. 2023-07-12 22:13:47,780 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:13:47,781 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 22:13:47,780 DEBUG [rs(jenkins-hbase4.apache.org,40411,1689200016125)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689200026071.4d68d9664cc96c9b019a44997df4ff6d. started... 2023-07-12 22:13:47,780 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 22:13:47,781 DEBUG [rs(jenkins-hbase4.apache.org,34497,1689200016186)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689200026071.8748574fb38143a2a5d3e24f437a695b. started... 2023-07-12 22:13:47,780 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 22:13:47,781 INFO [rs(jenkins-hbase4.apache.org,40411,1689200016125)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 4d68d9664cc96c9b019a44997df4ff6d 1/1 column families, dataSize=467 B heapSize=1.23 KB 2023-07-12 22:13:47,781 INFO [rs(jenkins-hbase4.apache.org,34497,1689200016186)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 8748574fb38143a2a5d3e24f437a695b 1/1 column families, dataSize=2.80 KB heapSize=6.30 KB 2023-07-12 22:13:47,783 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-12 22:13:47,783 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 22:13:47,784 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-12 22:13:47,829 DEBUG [Listener at jenkins-hbase4.apache.org/41531] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 22:13:47,832 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-12 22:13:47,832 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-12 22:13:47,833 DEBUG [Listener at jenkins-hbase4.apache.org/41531] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 22:13:47,948 INFO [rs(jenkins-hbase4.apache.org,40411,1689200016125)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023071227f9d365c8ba41e3b97a62588f5cb38b to hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e2023071227f9d365c8ba41e3b97a62588f5cb38b 2023-07-12 22:13:47,948 INFO [rs(jenkins-hbase4.apache.org,34497,1689200016186)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230712bdbde9fa65b74b1eab998a286fb134de to hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230712bdbde9fa65b74b1eab998a286fb134de 2023-07-12 22:13:47,988 INFO [rs(jenkins-hbase4.apache.org,34497,1689200016186)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.8 K, hasBloomFilter=true, into tmp file hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testExportWithTargetName/8748574fb38143a2a5d3e24f437a695b/.tmp/cf/ba4566af4bbe4fd78c44e913ff3971dc 2023-07-12 22:13:47,991 INFO [rs(jenkins-hbase4.apache.org,40411,1689200016125)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=467, hasBloomFilter=true, into tmp file hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testExportWithTargetName/4d68d9664cc96c9b019a44997df4ff6d/.tmp/cf/fcdd9b1eebf441feba290e364e8589af 2023-07-12 22:13:48,002 DEBUG [rs(jenkins-hbase4.apache.org,34497,1689200016186)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testExportWithTargetName/8748574fb38143a2a5d3e24f437a695b/.tmp/cf/ba4566af4bbe4fd78c44e913ff3971dc as hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testExportWithTargetName/8748574fb38143a2a5d3e24f437a695b/cf/ba4566af4bbe4fd78c44e913ff3971dc 2023-07-12 22:13:48,007 DEBUG [rs(jenkins-hbase4.apache.org,40411,1689200016125)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testExportWithTargetName/4d68d9664cc96c9b019a44997df4ff6d/.tmp/cf/fcdd9b1eebf441feba290e364e8589af as hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testExportWithTargetName/4d68d9664cc96c9b019a44997df4ff6d/cf/fcdd9b1eebf441feba290e364e8589af 2023-07-12 22:13:48,015 INFO [rs(jenkins-hbase4.apache.org,34497,1689200016186)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testExportWithTargetName/8748574fb38143a2a5d3e24f437a695b/cf/ba4566af4bbe4fd78c44e913ff3971dc, entries=43, sequenceid=6, filesize=12.1 K 2023-07-12 22:13:48,019 INFO [rs(jenkins-hbase4.apache.org,40411,1689200016125)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testExportWithTargetName/4d68d9664cc96c9b019a44997df4ff6d/cf/fcdd9b1eebf441feba290e364e8589af, entries=7, sequenceid=6, filesize=6.1 K 2023-07-12 22:13:48,022 INFO [rs(jenkins-hbase4.apache.org,34497,1689200016186)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.80 KB/2869, heapSize ~6.28 KB/6432, currentSize=0 B/0 for 8748574fb38143a2a5d3e24f437a695b in 241ms, sequenceid=6, compaction requested=false 2023-07-12 22:13:48,022 DEBUG [rs(jenkins-hbase4.apache.org,34497,1689200016186)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-12 22:13:48,023 INFO [rs(jenkins-hbase4.apache.org,40411,1689200016125)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~467 B/467, heapSize ~1.22 KB/1248, currentSize=0 B/0 for 4d68d9664cc96c9b019a44997df4ff6d in 242ms, sequenceid=6, compaction requested=false 2023-07-12 22:13:48,023 DEBUG [rs(jenkins-hbase4.apache.org,40411,1689200016125)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-12 22:13:48,025 DEBUG [rs(jenkins-hbase4.apache.org,34497,1689200016186)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8748574fb38143a2a5d3e24f437a695b: 2023-07-12 22:13:48,025 DEBUG [rs(jenkins-hbase4.apache.org,40411,1689200016125)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4d68d9664cc96c9b019a44997df4ff6d: 2023-07-12 22:13:48,025 DEBUG [rs(jenkins-hbase4.apache.org,34497,1689200016186)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689200026071.8748574fb38143a2a5d3e24f437a695b.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-12 22:13:48,025 DEBUG [rs(jenkins-hbase4.apache.org,40411,1689200016125)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689200026071.4d68d9664cc96c9b019a44997df4ff6d.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-12 22:13:48,025 DEBUG [rs(jenkins-hbase4.apache.org,34497,1689200016186)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 22:13:48,026 DEBUG [rs(jenkins-hbase4.apache.org,40411,1689200016125)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 22:13:48,026 DEBUG [rs(jenkins-hbase4.apache.org,40411,1689200016125)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testExportWithTargetName/4d68d9664cc96c9b019a44997df4ff6d/cf/fcdd9b1eebf441feba290e364e8589af] hfiles 2023-07-12 22:13:48,026 DEBUG [rs(jenkins-hbase4.apache.org,34497,1689200016186)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testExportWithTargetName/8748574fb38143a2a5d3e24f437a695b/cf/ba4566af4bbe4fd78c44e913ff3971dc] hfiles 2023-07-12 22:13:48,026 DEBUG [rs(jenkins-hbase4.apache.org,40411,1689200016125)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testExportWithTargetName/4d68d9664cc96c9b019a44997df4ff6d/cf/fcdd9b1eebf441feba290e364e8589af for snapshot=snaptb0-testExportWithTargetName 2023-07-12 22:13:48,026 DEBUG [rs(jenkins-hbase4.apache.org,34497,1689200016186)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testExportWithTargetName/8748574fb38143a2a5d3e24f437a695b/cf/ba4566af4bbe4fd78c44e913ff3971dc for snapshot=snaptb0-testExportWithTargetName 2023-07-12 22:13:48,034 DEBUG [Listener at jenkins-hbase4.apache.org/41531] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 22:13:48,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-12 22:13:48,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-12 22:13:48,038 DEBUG [Listener at jenkins-hbase4.apache.org/41531] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-12 22:13:48,054 DEBUG [rs(jenkins-hbase4.apache.org,40411,1689200016125)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689200026071.4d68d9664cc96c9b019a44997df4ff6d. completed. 2023-07-12 22:13:48,054 DEBUG [rs(jenkins-hbase4.apache.org,40411,1689200016125)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689200026071.4d68d9664cc96c9b019a44997df4ff6d. 2023-07-12 22:13:48,054 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 22:13:48,054 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 22:13:48,054 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:13:48,054 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-12 22:13:48,054 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,40411,1689200016125' in zk 2023-07-12 22:13:48,055 DEBUG [rs(jenkins-hbase4.apache.org,34497,1689200016186)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689200026071.8748574fb38143a2a5d3e24f437a695b. completed. 2023-07-12 22:13:48,055 DEBUG [rs(jenkins-hbase4.apache.org,34497,1689200016186)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689200026071.8748574fb38143a2a5d3e24f437a695b. 2023-07-12 22:13:48,055 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 22:13:48,055 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 22:13:48,055 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:13:48,055 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-12 22:13:48,055 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,34497,1689200016186' in zk 2023-07-12 22:13:48,057 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-12 22:13:48,057 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:13:48,057 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 22:13:48,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:13:48,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 22:13:48,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 22:13:48,058 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-12 22:13:48,059 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:13:48,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 22:13:48,059 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-12 22:13:48,059 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 22:13:48,060 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-12 22:13:48,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 22:13:48,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-12 22:13:48,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:13:48,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:13:48,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:13:48,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 22:13:48,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-12 22:13:48,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:13:48,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:13:48,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:13:48,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,40411,1689200016125': 2023-07-12 22:13:48,065 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40411,1689200016125' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-12 22:13:48,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:13:48,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 22:13:48,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 22:13:48,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 22:13:48,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 22:13:48,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-12 22:13:48,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:13:48,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:13:48,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:13:48,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 22:13:48,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-12 22:13:48,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:13:48,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:13:48,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:13:48,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,34497,1689200016186': 2023-07-12 22:13:48,071 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34497,1689200016186' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-12 22:13:48,071 INFO [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-07-12 22:13:48,071 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 22:13:48,071 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 22:13:48,071 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-07-12 22:13:48,071 INFO [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 22:13:48,073 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 22:13:48,073 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 22:13:48,073 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 22:13:48,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 22:13:48,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 22:13:48,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 22:13:48,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 22:13:48,073 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 22:13:48,073 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 22:13:48,073 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 22:13:48,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 22:13:48,073 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:13:48,073 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:13:48,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 22:13:48,073 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 22:13:48,073 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:13:48,074 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:13:48,074 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:13:48,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 22:13:48,074 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:13:48,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:13:48,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-12 22:13:48,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:13:48,074 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:13:48,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 22:13:48,074 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:13:48,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:13:48,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 22:13:48,075 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:13:48,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 22:13:48,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 22:13:48,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-12 22:13:48,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:13:48,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:13:48,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:13:48,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 22:13:48,077 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:13:48,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-12 22:13:48,078 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:13:48,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:13:48,078 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:13:48,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:13:48,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:13:48,093 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:13:48,093 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-12 22:13:48,093 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:13:48,093 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:13:48,093 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:13:48,093 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:13:48,093 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:13:48,093 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:13:48,093 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:13:48,093 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:13:48,094 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-12 22:13:48,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:13:48,094 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 22:13:48,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:13:48,093 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:13:48,094 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-07-12 22:13:48,095 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:13:48,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:13:48,094 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:13:48,095 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 22:13:48,095 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:13:48,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:13:48,095 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-07-12 22:13:48,095 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:13:48,095 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:13:48,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:13:48,095 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:13:48,095 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-12 22:13:48,096 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:13:48,096 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-12 22:13:48,096 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:13:48,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:13:48,096 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 22:13:48,096 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 22:13:48,097 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230712bdbde9fa65b74b1eab998a286fb134de, hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e2023071227f9d365c8ba41e3b97a62588f5cb38b] mob files 2023-07-12 22:13:48,097 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230712bdbde9fa65b74b1eab998a286fb134de 2023-07-12 22:13:48,098 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e2023071227f9d365c8ba41e3b97a62588f5cb38b 2023-07-12 22:13:48,112 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-07-12 22:13:48,113 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-12 22:13:48,160 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-12 22:13:48,206 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-12 22:13:48,207 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-12 22:13:48,207 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-12 22:13:48,207 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689200027727Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1689200028112 (+385 ms)Consolidate snapshot: snaptb0-testExportWithTargetName at 1689200028112Loading Region manifests for snaptb0-testExportWithTargetName at 1689200028113 (+1 ms)Writing data manifest for snaptb0-testExportWithTargetName at 1689200028122 (+9 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1689200028145 (+23 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689200028206 (+61 ms) 2023-07-12 22:13:48,211 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-12 22:13:48,216 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 484 msec 2023-07-12 22:13:48,338 DEBUG [Listener at jenkins-hbase4.apache.org/41531] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 22:13:48,342 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-12 22:13:48,342 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 22:13:48,343 INFO [Listener at jenkins-hbase4.apache.org/41531] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/export-test/export-1689200028343 2023-07-12 22:13:48,343 INFO [Listener at jenkins-hbase4.apache.org/41531] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:34335, tgtDir=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/export-test/export-1689200028343, rawTgtDir=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/export-test/export-1689200028343, srcFsUri=hdfs://localhost:34335, srcDir=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967 2023-07-12 22:13:48,389 DEBUG [Listener at jenkins-hbase4.apache.org/41531] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:34335, inputRoot=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967 2023-07-12 22:13:48,389 DEBUG [Listener at jenkins-hbase4.apache.org/41531] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1851028084_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/export-test/export-1689200028343, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/export-test/export-1689200028343/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-12 22:13:48,389 INFO [Listener at jenkins-hbase4.apache.org/41531] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:34335, inputRoot=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967, snapshotDir=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-07-12 22:13:48,431 INFO [Listener at jenkins-hbase4.apache.org/41531] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/export-test/export-1689200028343/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-12 22:13:48,958 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-12 22:13:48,959 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-12 22:13:48,959 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-12 22:13:48,960 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-12 22:13:48,960 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-12 22:13:48,961 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-12 22:13:48,961 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-12 22:13:49,058 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/652e6e64-efb3-f860-57fa-f551f44ecb6b/hadoop-5902312212871725249.jar 2023-07-12 22:13:49,059 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-12 22:13:49,059 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-12 22:13:49,060 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-12 22:13:49,060 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-12 22:13:49,061 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-12 22:13:49,061 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-12 22:13:49,062 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-12 22:13:49,062 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-12 22:13:49,063 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-12 22:13:49,064 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-12 22:13:49,064 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-12 22:13:49,065 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-12 22:13:49,065 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-12 22:13:49,066 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-12 22:13:49,066 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-12 22:13:49,067 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-12 22:13:49,072 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 22:13:49,072 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 22:13:49,073 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 22:13:49,073 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 22:13:49,074 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 22:13:49,075 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 22:13:49,075 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 22:13:50,128 WARN [Listener at jenkins-hbase4.apache.org/41531] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-12 22:13:50,135 INFO [Listener at jenkins-hbase4.apache.org/41531] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-07-12 22:13:50,145 DEBUG [Listener at jenkins-hbase4.apache.org/41531] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-07-12 22:13:50,650 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 22:13:50,652 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 22:13:50,844 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689200025069_0001_000001 (auth:SIMPLE) 2023-07-12 22:13:52,115 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-12 22:13:56,031 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689200025069_0001_000001 (auth:SIMPLE) 2023-07-12 22:13:58,306 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689200025069_0001_000001 (auth:SIMPLE) 2023-07-12 22:14:01,364 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689200025069_0001_000001 (auth:SIMPLE) 2023-07-12 22:14:03,062 INFO [Listener at jenkins-hbase4.apache.org/41531] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-12 22:14:03,065 INFO [Listener at jenkins-hbase4.apache.org/41531] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-12 22:14:03,075 INFO [Listener at jenkins-hbase4.apache.org/41531] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-07-12 22:14:03,076 INFO [Listener at jenkins-hbase4.apache.org/41531] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-12 22:14:03,076 INFO [Listener at jenkins-hbase4.apache.org/41531] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-12 22:14:03,077 DEBUG [Listener at jenkins-hbase4.apache.org/41531] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1346150702_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-12 22:14:03,077 DEBUG [Listener at jenkins-hbase4.apache.org/41531] snapshot.TestExportSnapshot(367): hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-07-12 22:14:03,077 DEBUG [Listener at jenkins-hbase4.apache.org/41531] snapshot.TestExportSnapshot(367): hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-07-12 22:14:03,077 DEBUG [Listener at jenkins-hbase4.apache.org/41531] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1346150702_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/export-test/export-1689200028343/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/export-test/export-1689200028343/.hbase-snapshot/testExportWithTargetName 2023-07-12 22:14:03,078 DEBUG [Listener at jenkins-hbase4.apache.org/41531] snapshot.TestExportSnapshot(367): hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/export-test/export-1689200028343/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-07-12 22:14:03,078 DEBUG [Listener at jenkins-hbase4.apache.org/41531] snapshot.TestExportSnapshot(367): hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/export-test/export-1689200028343/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-07-12 22:14:03,089 INFO [Listener at jenkins-hbase4.apache.org/41531] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-07-12 22:14:03,094 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-07-12 22:14:03,102 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] procedure2.ProcedureExecutor(1029): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-07-12 22:14:03,107 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689200043107"}]},"ts":"1689200043107"} 2023-07-12 22:14:03,108 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-12 22:14:03,109 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-07-12 22:14:03,111 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-07-12 22:14:03,113 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=4d68d9664cc96c9b019a44997df4ff6d, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=8748574fb38143a2a5d3e24f437a695b, UNASSIGN}] 2023-07-12 22:14:03,115 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=8748574fb38143a2a5d3e24f437a695b, UNASSIGN 2023-07-12 22:14:03,115 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=4d68d9664cc96c9b019a44997df4ff6d, UNASSIGN 2023-07-12 22:14:03,116 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=8748574fb38143a2a5d3e24f437a695b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:14:03,116 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=4d68d9664cc96c9b019a44997df4ff6d, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:14:03,116 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689200026071.8748574fb38143a2a5d3e24f437a695b.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689200043116"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689200043116"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689200043116"}]},"ts":"1689200043116"} 2023-07-12 22:14:03,117 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689200026071.4d68d9664cc96c9b019a44997df4ff6d.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689200043116"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689200043116"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689200043116"}]},"ts":"1689200043116"} 2023-07-12 22:14:03,118 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE; CloseRegionProcedure 8748574fb38143a2a5d3e24f437a695b, server=jenkins-hbase4.apache.org,34497,1689200016186}] 2023-07-12 22:14:03,119 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=22, state=RUNNABLE; CloseRegionProcedure 4d68d9664cc96c9b019a44997df4ff6d, server=jenkins-hbase4.apache.org,40411,1689200016125}] 2023-07-12 22:14:03,209 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-12 22:14:03,279 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 4d68d9664cc96c9b019a44997df4ff6d 2023-07-12 22:14:03,279 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 8748574fb38143a2a5d3e24f437a695b 2023-07-12 22:14:03,280 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 4d68d9664cc96c9b019a44997df4ff6d, disabling compactions & flushes 2023-07-12 22:14:03,280 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 8748574fb38143a2a5d3e24f437a695b, disabling compactions & flushes 2023-07-12 22:14:03,280 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689200026071.4d68d9664cc96c9b019a44997df4ff6d. 2023-07-12 22:14:03,280 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689200026071.8748574fb38143a2a5d3e24f437a695b. 2023-07-12 22:14:03,280 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689200026071.4d68d9664cc96c9b019a44997df4ff6d. 2023-07-12 22:14:03,280 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689200026071.8748574fb38143a2a5d3e24f437a695b. 2023-07-12 22:14:03,280 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689200026071.4d68d9664cc96c9b019a44997df4ff6d. after waiting 0 ms 2023-07-12 22:14:03,280 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689200026071.4d68d9664cc96c9b019a44997df4ff6d. 2023-07-12 22:14:03,280 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689200026071.8748574fb38143a2a5d3e24f437a695b. after waiting 0 ms 2023-07-12 22:14:03,280 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689200026071.8748574fb38143a2a5d3e24f437a695b. 2023-07-12 22:14:03,294 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testExportWithTargetName/8748574fb38143a2a5d3e24f437a695b/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 22:14:03,294 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testExportWithTargetName/4d68d9664cc96c9b019a44997df4ff6d/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 22:14:03,294 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 22:14:03,295 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 22:14:03,296 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689200026071.8748574fb38143a2a5d3e24f437a695b. 2023-07-12 22:14:03,296 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689200026071.4d68d9664cc96c9b019a44997df4ff6d. 2023-07-12 22:14:03,296 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 8748574fb38143a2a5d3e24f437a695b: 2023-07-12 22:14:03,296 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 4d68d9664cc96c9b019a44997df4ff6d: 2023-07-12 22:14:03,299 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 8748574fb38143a2a5d3e24f437a695b 2023-07-12 22:14:03,300 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=8748574fb38143a2a5d3e24f437a695b, regionState=CLOSED 2023-07-12 22:14:03,300 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 4d68d9664cc96c9b019a44997df4ff6d 2023-07-12 22:14:03,300 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689200026071.8748574fb38143a2a5d3e24f437a695b.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689200043300"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689200043300"}]},"ts":"1689200043300"} 2023-07-12 22:14:03,301 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=4d68d9664cc96c9b019a44997df4ff6d, regionState=CLOSED 2023-07-12 22:14:03,301 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689200026071.4d68d9664cc96c9b019a44997df4ff6d.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689200043301"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689200043301"}]},"ts":"1689200043301"} 2023-07-12 22:14:03,307 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=23 2023-07-12 22:14:03,307 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=23, state=SUCCESS; CloseRegionProcedure 8748574fb38143a2a5d3e24f437a695b, server=jenkins-hbase4.apache.org,34497,1689200016186 in 186 msec 2023-07-12 22:14:03,309 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=8748574fb38143a2a5d3e24f437a695b, UNASSIGN in 194 msec 2023-07-12 22:14:03,313 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=22 2023-07-12 22:14:03,313 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=22, state=SUCCESS; CloseRegionProcedure 4d68d9664cc96c9b019a44997df4ff6d, server=jenkins-hbase4.apache.org,40411,1689200016125 in 187 msec 2023-07-12 22:14:03,315 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=21 2023-07-12 22:14:03,315 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=4d68d9664cc96c9b019a44997df4ff6d, UNASSIGN in 200 msec 2023-07-12 22:14:03,316 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689200043316"}]},"ts":"1689200043316"} 2023-07-12 22:14:03,320 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-07-12 22:14:03,321 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-07-12 22:14:03,325 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 225 msec 2023-07-12 22:14:03,410 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-12 22:14:03,411 INFO [Listener at jenkins-hbase4.apache.org/41531] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-07-12 22:14:03,416 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-07-12 22:14:03,423 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-12 22:14:03,426 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-12 22:14:03,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-07-12 22:14:03,428 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-12 22:14:03,432 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34497] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-07-12 22:14:03,435 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testExportWithTargetName/4d68d9664cc96c9b019a44997df4ff6d 2023-07-12 22:14:03,435 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testExportWithTargetName/8748574fb38143a2a5d3e24f437a695b 2023-07-12 22:14:03,436 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-12 22:14:03,437 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-12 22:14:03,437 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-12 22:14:03,436 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-12 22:14:03,438 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-12 22:14:03,438 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-12 22:14:03,438 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-12 22:14:03,438 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-12 22:14:03,440 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-12 22:14:03,440 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-12 22:14:03,440 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 22:14:03,440 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-12 22:14:03,440 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-12 22:14:03,440 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 22:14:03,440 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 22:14:03,440 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 22:14:03,440 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testExportWithTargetName/4d68d9664cc96c9b019a44997df4ff6d/cf, FileablePath, hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testExportWithTargetName/4d68d9664cc96c9b019a44997df4ff6d/recovered.edits] 2023-07-12 22:14:03,440 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testExportWithTargetName/8748574fb38143a2a5d3e24f437a695b/cf, FileablePath, hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testExportWithTargetName/8748574fb38143a2a5d3e24f437a695b/recovered.edits] 2023-07-12 22:14:03,444 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-12 22:14:03,450 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testExportWithTargetName/8748574fb38143a2a5d3e24f437a695b/cf/ba4566af4bbe4fd78c44e913ff3971dc to hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/archive/data/default/testtb-testExportWithTargetName/8748574fb38143a2a5d3e24f437a695b/cf/ba4566af4bbe4fd78c44e913ff3971dc 2023-07-12 22:14:03,450 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testExportWithTargetName/4d68d9664cc96c9b019a44997df4ff6d/cf/fcdd9b1eebf441feba290e364e8589af to hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/archive/data/default/testtb-testExportWithTargetName/4d68d9664cc96c9b019a44997df4ff6d/cf/fcdd9b1eebf441feba290e364e8589af 2023-07-12 22:14:03,457 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testExportWithTargetName/4d68d9664cc96c9b019a44997df4ff6d/recovered.edits/9.seqid to hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/archive/data/default/testtb-testExportWithTargetName/4d68d9664cc96c9b019a44997df4ff6d/recovered.edits/9.seqid 2023-07-12 22:14:03,458 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testExportWithTargetName/4d68d9664cc96c9b019a44997df4ff6d 2023-07-12 22:14:03,460 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testExportWithTargetName/8748574fb38143a2a5d3e24f437a695b/recovered.edits/9.seqid to hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/archive/data/default/testtb-testExportWithTargetName/8748574fb38143a2a5d3e24f437a695b/recovered.edits/9.seqid 2023-07-12 22:14:03,461 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testExportWithTargetName/8748574fb38143a2a5d3e24f437a695b 2023-07-12 22:14:03,461 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-12 22:14:03,461 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-07-12 22:14:03,462 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf] 2023-07-12 22:14:03,467 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230712bdbde9fa65b74b1eab998a286fb134de to hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230712bdbde9fa65b74b1eab998a286fb134de 2023-07-12 22:14:03,468 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e2023071227f9d365c8ba41e3b97a62588f5cb38b to hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e2023071227f9d365c8ba41e3b97a62588f5cb38b 2023-07-12 22:14:03,469 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-07-12 22:14:03,472 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-12 22:14:03,494 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-07-12 22:14:03,497 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-07-12 22:14:03,499 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-12 22:14:03,499 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-07-12 22:14:03,499 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1689200026071.4d68d9664cc96c9b019a44997df4ff6d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689200043499"}]},"ts":"9223372036854775807"} 2023-07-12 22:14:03,499 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1689200026071.8748574fb38143a2a5d3e24f437a695b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689200043499"}]},"ts":"9223372036854775807"} 2023-07-12 22:14:03,501 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-12 22:14:03,501 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 4d68d9664cc96c9b019a44997df4ff6d, NAME => 'testtb-testExportWithTargetName,,1689200026071.4d68d9664cc96c9b019a44997df4ff6d.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 8748574fb38143a2a5d3e24f437a695b, NAME => 'testtb-testExportWithTargetName,1,1689200026071.8748574fb38143a2a5d3e24f437a695b.', STARTKEY => '1', ENDKEY => ''}] 2023-07-12 22:14:03,501 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-07-12 22:14:03,502 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689200043502"}]},"ts":"9223372036854775807"} 2023-07-12 22:14:03,504 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-07-12 22:14:03,507 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-12 22:14:03,510 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 90 msec 2023-07-12 22:14:03,545 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-12 22:14:03,548 INFO [Listener at jenkins-hbase4.apache.org/41531] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-07-12 22:14:03,575 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-07-12 22:14:03,579 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-07-12 22:14:03,583 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-07-12 22:14:03,585 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-07-12 22:14:03,614 INFO [Listener at jenkins-hbase4.apache.org/41531] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=752 (was 708) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x407c7a8e-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x407c7a8e-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/652e6e64-efb3-f860-57fa-f551f44ecb6b/cluster_dcbc62b2-e874-eae0-66ca-6b0e7e7d42e3/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x407c7a8e-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/652e6e64-efb3-f860-57fa-f551f44ecb6b/cluster_dcbc62b2-e874-eae0-66ca-6b0e7e7d42e3/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-388370204_1 at /127.0.0.1:52418 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1346150702_17 at /127.0.0.1:35454 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (337744187) connection to jenkins-hbase4.apache.org/172.31.14.131:44655 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/652e6e64-efb3-f860-57fa-f551f44ecb6b/cluster_dcbc62b2-e874-eae0-66ca-6b0e7e7d42e3/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/652e6e64-efb3-f860-57fa-f551f44ecb6b/cluster_dcbc62b2-e874-eae0-66ca-6b0e7e7d42e3/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (337744187) connection to jenkins-hbase4.apache.org/172.31.14.131:42041 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Thread-1312 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x407c7a8e-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1346150702_17 at /127.0.0.1:52436 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/652e6e64-efb3-f860-57fa-f551f44ecb6b/cluster_dcbc62b2-e874-eae0-66ca-6b0e7e7d42e3/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1346150702_17 at /127.0.0.1:49338 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/652e6e64-efb3-f860-57fa-f551f44ecb6b/cluster_dcbc62b2-e874-eae0-66ca-6b0e7e7d42e3/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=923 (was 900) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=432 (was 294) - SystemLoadAverage LEAK? -, ProcessCount=180 (was 174) - ProcessCount LEAK? -, AvailableMemoryMB=4852 (was 6547) 2023-07-12 22:14:03,615 WARN [Listener at jenkins-hbase4.apache.org/41531] hbase.ResourceChecker(130): Thread=752 is superior to 500 2023-07-12 22:14:03,638 INFO [Listener at jenkins-hbase4.apache.org/41531] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=752, OpenFileDescriptor=923, MaxFileDescriptor=60000, SystemLoadAverage=432, ProcessCount=180, AvailableMemoryMB=4851 2023-07-12 22:14:03,638 WARN [Listener at jenkins-hbase4.apache.org/41531] hbase.ResourceChecker(130): Thread=752 is superior to 500 2023-07-12 22:14:03,640 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-12 22:14:03,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-07-12 22:14:03,645 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 22:14:03,646 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-07-12 22:14:03,647 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 22:14:03,647 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-12 22:14:03,650 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testExportFileSystemState/74f4020a002ceda29dfc0f056b6181c6 2023-07-12 22:14:03,650 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testExportFileSystemState/c03edf1239e85b41a507c640b5ec3c95 2023-07-12 22:14:03,650 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testExportFileSystemState/74f4020a002ceda29dfc0f056b6181c6 empty. 2023-07-12 22:14:03,650 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testExportFileSystemState/c03edf1239e85b41a507c640b5ec3c95 empty. 2023-07-12 22:14:03,651 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testExportFileSystemState/74f4020a002ceda29dfc0f056b6181c6 2023-07-12 22:14:03,651 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testExportFileSystemState/c03edf1239e85b41a507c640b5ec3c95 2023-07-12 22:14:03,651 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-12 22:14:03,666 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-12 22:14:03,668 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 74f4020a002ceda29dfc0f056b6181c6, NAME => 'testtb-testExportFileSystemState,,1689200043640.74f4020a002ceda29dfc0f056b6181c6.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp 2023-07-12 22:14:03,668 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => c03edf1239e85b41a507c640b5ec3c95, NAME => 'testtb-testExportFileSystemState,1,1689200043640.c03edf1239e85b41a507c640b5ec3c95.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp 2023-07-12 22:14:03,712 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689200043640.c03edf1239e85b41a507c640b5ec3c95.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 22:14:03,712 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing c03edf1239e85b41a507c640b5ec3c95, disabling compactions & flushes 2023-07-12 22:14:03,712 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689200043640.c03edf1239e85b41a507c640b5ec3c95. 2023-07-12 22:14:03,712 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689200043640.c03edf1239e85b41a507c640b5ec3c95. 2023-07-12 22:14:03,712 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689200043640.c03edf1239e85b41a507c640b5ec3c95. after waiting 0 ms 2023-07-12 22:14:03,712 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689200043640.c03edf1239e85b41a507c640b5ec3c95. 2023-07-12 22:14:03,712 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689200043640.c03edf1239e85b41a507c640b5ec3c95. 2023-07-12 22:14:03,712 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for c03edf1239e85b41a507c640b5ec3c95: 2023-07-12 22:14:03,748 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-12 22:14:03,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-12 22:14:04,108 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689200043640.74f4020a002ceda29dfc0f056b6181c6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 22:14:04,108 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 74f4020a002ceda29dfc0f056b6181c6, disabling compactions & flushes 2023-07-12 22:14:04,108 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689200043640.74f4020a002ceda29dfc0f056b6181c6. 2023-07-12 22:14:04,108 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689200043640.74f4020a002ceda29dfc0f056b6181c6. 2023-07-12 22:14:04,108 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689200043640.74f4020a002ceda29dfc0f056b6181c6. after waiting 0 ms 2023-07-12 22:14:04,108 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689200043640.74f4020a002ceda29dfc0f056b6181c6. 2023-07-12 22:14:04,108 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689200043640.74f4020a002ceda29dfc0f056b6181c6. 2023-07-12 22:14:04,108 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 74f4020a002ceda29dfc0f056b6181c6: 2023-07-12 22:14:04,111 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 22:14:04,112 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689200043640.c03edf1239e85b41a507c640b5ec3c95.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689200044112"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689200044112"}]},"ts":"1689200044112"} 2023-07-12 22:14:04,112 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689200043640.74f4020a002ceda29dfc0f056b6181c6.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689200044112"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689200044112"}]},"ts":"1689200044112"} 2023-07-12 22:14:04,115 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-12 22:14:04,116 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 22:14:04,116 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689200044116"}]},"ts":"1689200044116"} 2023-07-12 22:14:04,117 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-07-12 22:14:04,122 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-12 22:14:04,123 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 22:14:04,123 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 22:14:04,123 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-12 22:14:04,123 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 22:14:04,123 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=74f4020a002ceda29dfc0f056b6181c6, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=c03edf1239e85b41a507c640b5ec3c95, ASSIGN}] 2023-07-12 22:14:04,126 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=74f4020a002ceda29dfc0f056b6181c6, ASSIGN 2023-07-12 22:14:04,126 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=c03edf1239e85b41a507c640b5ec3c95, ASSIGN 2023-07-12 22:14:04,127 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=74f4020a002ceda29dfc0f056b6181c6, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37349,1689200016037; forceNewPlan=false, retain=false 2023-07-12 22:14:04,127 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=c03edf1239e85b41a507c640b5ec3c95, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34497,1689200016186; forceNewPlan=false, retain=false 2023-07-12 22:14:04,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-12 22:14:04,277 INFO [jenkins-hbase4:43225] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-12 22:14:04,280 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=c03edf1239e85b41a507c640b5ec3c95, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:14:04,280 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=74f4020a002ceda29dfc0f056b6181c6, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:04,280 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689200043640.c03edf1239e85b41a507c640b5ec3c95.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689200044280"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689200044280"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689200044280"}]},"ts":"1689200044280"} 2023-07-12 22:14:04,281 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689200043640.74f4020a002ceda29dfc0f056b6181c6.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689200044280"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689200044280"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689200044280"}]},"ts":"1689200044280"} 2023-07-12 22:14:04,283 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=29, state=RUNNABLE; OpenRegionProcedure c03edf1239e85b41a507c640b5ec3c95, server=jenkins-hbase4.apache.org,34497,1689200016186}] 2023-07-12 22:14:04,285 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=28, state=RUNNABLE; OpenRegionProcedure 74f4020a002ceda29dfc0f056b6181c6, server=jenkins-hbase4.apache.org,37349,1689200016037}] 2023-07-12 22:14:04,442 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1689200043640.c03edf1239e85b41a507c640b5ec3c95. 2023-07-12 22:14:04,442 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c03edf1239e85b41a507c640b5ec3c95, NAME => 'testtb-testExportFileSystemState,1,1689200043640.c03edf1239e85b41a507c640b5ec3c95.', STARTKEY => '1', ENDKEY => ''} 2023-07-12 22:14:04,443 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1689200043640.c03edf1239e85b41a507c640b5ec3c95. service=AccessControlService 2023-07-12 22:14:04,444 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 22:14:04,444 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState c03edf1239e85b41a507c640b5ec3c95 2023-07-12 22:14:04,444 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689200043640.c03edf1239e85b41a507c640b5ec3c95.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 22:14:04,444 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c03edf1239e85b41a507c640b5ec3c95 2023-07-12 22:14:04,444 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c03edf1239e85b41a507c640b5ec3c95 2023-07-12 22:14:04,446 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1689200043640.74f4020a002ceda29dfc0f056b6181c6. 2023-07-12 22:14:04,446 INFO [StoreOpener-c03edf1239e85b41a507c640b5ec3c95-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region c03edf1239e85b41a507c640b5ec3c95 2023-07-12 22:14:04,446 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 74f4020a002ceda29dfc0f056b6181c6, NAME => 'testtb-testExportFileSystemState,,1689200043640.74f4020a002ceda29dfc0f056b6181c6.', STARTKEY => '', ENDKEY => '1'} 2023-07-12 22:14:04,447 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1689200043640.74f4020a002ceda29dfc0f056b6181c6. service=AccessControlService 2023-07-12 22:14:04,447 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 22:14:04,447 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 74f4020a002ceda29dfc0f056b6181c6 2023-07-12 22:14:04,447 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689200043640.74f4020a002ceda29dfc0f056b6181c6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 22:14:04,447 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 74f4020a002ceda29dfc0f056b6181c6 2023-07-12 22:14:04,447 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 74f4020a002ceda29dfc0f056b6181c6 2023-07-12 22:14:04,448 DEBUG [StoreOpener-c03edf1239e85b41a507c640b5ec3c95-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testExportFileSystemState/c03edf1239e85b41a507c640b5ec3c95/cf 2023-07-12 22:14:04,448 DEBUG [StoreOpener-c03edf1239e85b41a507c640b5ec3c95-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testExportFileSystemState/c03edf1239e85b41a507c640b5ec3c95/cf 2023-07-12 22:14:04,448 INFO [StoreOpener-c03edf1239e85b41a507c640b5ec3c95-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c03edf1239e85b41a507c640b5ec3c95 columnFamilyName cf 2023-07-12 22:14:04,449 INFO [StoreOpener-74f4020a002ceda29dfc0f056b6181c6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 74f4020a002ceda29dfc0f056b6181c6 2023-07-12 22:14:04,450 DEBUG [StoreOpener-74f4020a002ceda29dfc0f056b6181c6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testExportFileSystemState/74f4020a002ceda29dfc0f056b6181c6/cf 2023-07-12 22:14:04,450 INFO [StoreOpener-c03edf1239e85b41a507c640b5ec3c95-1] regionserver.HStore(310): Store=c03edf1239e85b41a507c640b5ec3c95/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 22:14:04,450 DEBUG [StoreOpener-74f4020a002ceda29dfc0f056b6181c6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testExportFileSystemState/74f4020a002ceda29dfc0f056b6181c6/cf 2023-07-12 22:14:04,451 INFO [StoreOpener-74f4020a002ceda29dfc0f056b6181c6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 74f4020a002ceda29dfc0f056b6181c6 columnFamilyName cf 2023-07-12 22:14:04,452 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testExportFileSystemState/c03edf1239e85b41a507c640b5ec3c95 2023-07-12 22:14:04,452 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testExportFileSystemState/c03edf1239e85b41a507c640b5ec3c95 2023-07-12 22:14:04,452 INFO [StoreOpener-74f4020a002ceda29dfc0f056b6181c6-1] regionserver.HStore(310): Store=74f4020a002ceda29dfc0f056b6181c6/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 22:14:04,454 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testExportFileSystemState/74f4020a002ceda29dfc0f056b6181c6 2023-07-12 22:14:04,455 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testExportFileSystemState/74f4020a002ceda29dfc0f056b6181c6 2023-07-12 22:14:04,456 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c03edf1239e85b41a507c640b5ec3c95 2023-07-12 22:14:04,458 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 74f4020a002ceda29dfc0f056b6181c6 2023-07-12 22:14:04,459 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testExportFileSystemState/c03edf1239e85b41a507c640b5ec3c95/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 22:14:04,459 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c03edf1239e85b41a507c640b5ec3c95; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66346276, jitterRate=-0.011363446712493896}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 22:14:04,459 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c03edf1239e85b41a507c640b5ec3c95: 2023-07-12 22:14:04,460 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1689200043640.c03edf1239e85b41a507c640b5ec3c95., pid=30, masterSystemTime=1689200044435 2023-07-12 22:14:04,460 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testExportFileSystemState/74f4020a002ceda29dfc0f056b6181c6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 22:14:04,461 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 74f4020a002ceda29dfc0f056b6181c6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65145397, jitterRate=-0.029257938265800476}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 22:14:04,461 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 74f4020a002ceda29dfc0f056b6181c6: 2023-07-12 22:14:04,462 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1689200043640.74f4020a002ceda29dfc0f056b6181c6., pid=31, masterSystemTime=1689200044437 2023-07-12 22:14:04,462 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1689200043640.c03edf1239e85b41a507c640b5ec3c95. 2023-07-12 22:14:04,462 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1689200043640.c03edf1239e85b41a507c640b5ec3c95. 2023-07-12 22:14:04,463 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=c03edf1239e85b41a507c640b5ec3c95, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:14:04,463 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1689200043640.c03edf1239e85b41a507c640b5ec3c95.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689200044463"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689200044463"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689200044463"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689200044463"}]},"ts":"1689200044463"} 2023-07-12 22:14:04,463 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1689200043640.74f4020a002ceda29dfc0f056b6181c6. 2023-07-12 22:14:04,463 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1689200043640.74f4020a002ceda29dfc0f056b6181c6. 2023-07-12 22:14:04,464 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=74f4020a002ceda29dfc0f056b6181c6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:04,465 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1689200043640.74f4020a002ceda29dfc0f056b6181c6.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689200044464"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689200044464"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689200044464"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689200044464"}]},"ts":"1689200044464"} 2023-07-12 22:14:04,468 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=29 2023-07-12 22:14:04,468 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=29, state=SUCCESS; OpenRegionProcedure c03edf1239e85b41a507c640b5ec3c95, server=jenkins-hbase4.apache.org,34497,1689200016186 in 182 msec 2023-07-12 22:14:04,469 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=28 2023-07-12 22:14:04,472 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=28, state=SUCCESS; OpenRegionProcedure 74f4020a002ceda29dfc0f056b6181c6, server=jenkins-hbase4.apache.org,37349,1689200016037 in 182 msec 2023-07-12 22:14:04,474 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=c03edf1239e85b41a507c640b5ec3c95, ASSIGN in 345 msec 2023-07-12 22:14:04,475 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=27 2023-07-12 22:14:04,476 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=74f4020a002ceda29dfc0f056b6181c6, ASSIGN in 349 msec 2023-07-12 22:14:04,477 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 22:14:04,477 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689200044477"}]},"ts":"1689200044477"} 2023-07-12 22:14:04,478 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-07-12 22:14:04,482 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 22:14:04,482 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-07-12 22:14:04,484 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34497] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-12 22:14:04,486 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 22:14:04,486 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 22:14:04,486 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 22:14:04,486 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 22:14:04,487 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-12 22:14:04,488 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-12 22:14:04,488 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-12 22:14:04,489 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-12 22:14:04,494 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 847 msec 2023-07-12 22:14:04,757 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-12 22:14:04,758 INFO [Listener at jenkins-hbase4.apache.org/41531] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-07-12 22:14:04,761 DEBUG [Listener at jenkins-hbase4.apache.org/41531] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-12 22:14:04,762 DEBUG [Listener at jenkins-hbase4.apache.org/41531] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1689200043640.74f4020a002ceda29dfc0f056b6181c6. 2023-07-12 22:14:04,764 INFO [Listener at jenkins-hbase4.apache.org/41531] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 22:14:04,775 DEBUG [hconnection-0x6ea28f2d-shared-pool-10] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 22:14:04,779 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55546, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 22:14:04,787 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 22:14:04,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689200044787 (current time:1689200044787). 2023-07-12 22:14:04,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 22:14:04,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] zookeeper.ReadOnlyZKClient(139): Connect 0x762aa867 to 127.0.0.1:62393 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 22:14:04,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@606455ac, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 22:14:04,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 22:14:04,797 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55934, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 22:14:04,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x762aa867 to 127.0.0.1:62393 2023-07-12 22:14:04,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 22:14:04,799 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] zookeeper.ReadOnlyZKClient(139): Connect 0x6a6ba521 to 127.0.0.1:62393 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 22:14:04,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4921519b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 22:14:04,806 DEBUG [hconnection-0xb2aa426-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 22:14:04,808 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55950, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 22:14:04,812 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 22:14:04,815 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40100, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 22:14:04,816 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6a6ba521 to 127.0.0.1:62393 2023-07-12 22:14:04,816 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 22:14:04,817 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-12 22:14:04,817 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 22:14:04,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 22:14:04,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-12 22:14:04,821 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-12 22:14:04,822 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689200644822 2023-07-12 22:14:04,822 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 22:14:04,822 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-12 22:14:04,824 DEBUG [Listener at jenkins-hbase4.apache.org/41531] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 22:14:04,824 DEBUG [Listener at jenkins-hbase4.apache.org/41531] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 22:14:04,825 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-12 22:14:04,825 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-12 22:14:04,827 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 7 msec 2023-07-12 22:14:04,828 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-12 22:14:04,829 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689200644829 2023-07-12 22:14:04,846 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,847 INFO [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-07-12 22:14:04,847 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 22:14:04,848 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-07-12 22:14:04,848 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-12 22:14:04,849 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,849 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,851 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:14:04,851 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:14:04,851 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:14:04,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:14:04,851 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:14:04,851 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:14:04,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:14:04,851 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:14:04,851 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:14:04,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:14:04,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,852 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:14:04,852 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:04,852 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,852 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,852 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:04,853 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 22:14:04,853 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-12 22:14:04,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,853 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-12 22:14:04,853 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-12 22:14:04,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,853 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-12 22:14:04,854 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 22:14:04,854 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-12 22:14:04,854 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-12 22:14:04,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,856 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-12 22:14:04,856 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-12 22:14:04,856 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-12 22:14:04,856 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34497,1689200016186' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-12 22:14:04,854 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-12 22:14:04,857 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,857 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 22:14:04,857 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-12 22:14:04,857 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 22:14:04,858 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-12 22:14:04,858 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-12 22:14:04,858 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37349,1689200016037' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-12 22:14:04,858 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-12 22:14:04,858 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-12 22:14:04,858 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40411,1689200016125' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-12 22:14:04,860 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:14:04,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:14:04,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 22:14:04,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 22:14:04,860 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,868 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,868 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 22:14:04,868 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 22:14:04,868 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:04,868 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,868 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,868 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 22:14:04,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 22:14:04,868 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,868 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 22:14:04,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:14:04,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:14:04,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:04,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 22:14:04,870 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34497,1689200016186' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-12 22:14:04,870 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@296641de[Count = 1] remaining members to acquire global barrier 2023-07-12 22:14:04,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:04,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 22:14:04,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 22:14:04,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 22:14:04,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 22:14:04,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:14:04,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:14:04,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:04,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 22:14:04,873 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37349,1689200016037' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-12 22:14:04,873 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@296641de[Count = 0] remaining members to acquire global barrier 2023-07-12 22:14:04,873 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-12 22:14:04,873 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,874 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,874 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,874 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,874 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,874 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,875 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:14:04,875 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,875 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-12 22:14:04,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,875 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-12 22:14:04,875 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-12 22:14:04,875 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-12 22:14:04,875 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40411,1689200016125' in zk 2023-07-12 22:14:04,875 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:04,875 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 22:14:04,875 DEBUG [rs(jenkins-hbase4.apache.org,34497,1689200016186)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689200043640.c03edf1239e85b41a507c640b5ec3c95. 2023-07-12 22:14:04,875 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 22:14:04,875 DEBUG [rs(jenkins-hbase4.apache.org,37349,1689200016037)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689200043640.74f4020a002ceda29dfc0f056b6181c6. 2023-07-12 22:14:04,875 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 22:14:04,875 DEBUG [rs(jenkins-hbase4.apache.org,34497,1689200016186)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689200043640.c03edf1239e85b41a507c640b5ec3c95. started... 2023-07-12 22:14:04,875 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 22:14:04,876 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 22:14:04,875 DEBUG [rs(jenkins-hbase4.apache.org,37349,1689200016037)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689200043640.74f4020a002ceda29dfc0f056b6181c6. started... 2023-07-12 22:14:04,877 DEBUG [rs(jenkins-hbase4.apache.org,34497,1689200016186)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c03edf1239e85b41a507c640b5ec3c95: 2023-07-12 22:14:04,877 DEBUG [rs(jenkins-hbase4.apache.org,37349,1689200016037)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 74f4020a002ceda29dfc0f056b6181c6: 2023-07-12 22:14:04,877 DEBUG [rs(jenkins-hbase4.apache.org,34497,1689200016186)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689200043640.c03edf1239e85b41a507c640b5ec3c95.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,877 DEBUG [rs(jenkins-hbase4.apache.org,34497,1689200016186)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 22:14:04,877 DEBUG [rs(jenkins-hbase4.apache.org,37349,1689200016037)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689200043640.74f4020a002ceda29dfc0f056b6181c6.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,877 DEBUG [rs(jenkins-hbase4.apache.org,34497,1689200016186)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 22:14:04,877 DEBUG [rs(jenkins-hbase4.apache.org,37349,1689200016037)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 22:14:04,877 DEBUG [rs(jenkins-hbase4.apache.org,37349,1689200016037)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 22:14:04,879 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-12 22:14:04,879 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 22:14:04,879 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-12 22:14:04,891 DEBUG [rs(jenkins-hbase4.apache.org,34497,1689200016186)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689200043640.c03edf1239e85b41a507c640b5ec3c95. completed. 2023-07-12 22:14:04,891 DEBUG [rs(jenkins-hbase4.apache.org,34497,1689200016186)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689200043640.c03edf1239e85b41a507c640b5ec3c95. 2023-07-12 22:14:04,892 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 22:14:04,892 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 22:14:04,892 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:14:04,892 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-12 22:14:04,892 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,34497,1689200016186' in zk 2023-07-12 22:14:04,893 DEBUG [rs(jenkins-hbase4.apache.org,37349,1689200016037)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689200043640.74f4020a002ceda29dfc0f056b6181c6. completed. 2023-07-12 22:14:04,893 DEBUG [rs(jenkins-hbase4.apache.org,37349,1689200016037)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689200043640.74f4020a002ceda29dfc0f056b6181c6. 2023-07-12 22:14:04,893 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 22:14:04,893 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 22:14:04,893 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:04,893 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-12 22:14:04,893 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,37349,1689200016037' in zk 2023-07-12 22:14:04,894 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-12 22:14:04,894 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 22:14:04,894 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:14:04,894 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-12 22:14:04,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:14:04,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 22:14:04,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 22:14:04,897 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:04,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 22:14:04,897 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-12 22:14:04,897 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 22:14:04,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 22:14:04,897 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-12 22:14:04,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:14:04,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:14:04,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:04,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 22:14:04,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:14:04,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:14:04,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:04,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,34497,1689200016186': 2023-07-12 22:14:04,904 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34497,1689200016186' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-12 22:14:04,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:04,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 22:14:04,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 22:14:04,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 22:14:04,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 22:14:04,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:14:04,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:14:04,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:04,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 22:14:04,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:14:04,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:14:04,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:04,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,37349,1689200016037': 2023-07-12 22:14:04,909 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37349,1689200016037' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-12 22:14:04,909 INFO [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-07-12 22:14:04,909 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 22:14:04,909 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 22:14:04,909 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,909 INFO [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 22:14:04,912 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,912 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,912 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,912 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,912 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,912 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:14:04,912 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,913 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:14:04,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:14:04,912 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:14:04,913 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:14:04,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:14:04,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,912 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:14:04,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,912 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,913 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:14:04,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 22:14:04,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 22:14:04,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:14:04,914 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:14:04,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 22:14:04,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,915 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:14:04,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,915 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:04,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 22:14:04,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:14:04,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:14:04,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:04,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 22:14:04,917 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:14:04,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,918 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:14:04,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:14:04,918 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:04,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:14:04,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:04,921 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:04,921 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:14:04,921 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:14:04,921 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,922 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:14:04,922 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:14:04,922 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:14:04,922 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 22:14:04,922 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:14:04,922 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:14:04,921 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:14:04,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:14:04,922 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,922 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:14:04,924 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-07-12 22:14:04,922 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:14:04,922 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:14:04,924 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,924 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,924 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:14:04,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:14:04,924 DEBUG [Listener at jenkins-hbase4.apache.org/41531] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 22:14:04,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:14:04,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:14:04,924 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:04,924 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-12 22:14:04,924 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,924 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:14:04,924 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:14:04,924 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,924 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:14:04,925 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:14:04,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:14:04,924 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:14:04,925 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-12 22:14:04,927 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-12 22:14:04,927 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-12 22:14:04,927 DEBUG [Listener at jenkins-hbase4.apache.org/41531] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 22:14:04,935 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,936 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,991 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:05,056 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-12 22:14:05,056 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:05,057 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:05,057 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689200044823Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1689200044935 (+112 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1689200044935Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1689200044935Writing data manifest for emptySnaptb0-testExportFileSystemState at 1689200044941 (+6 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1689200044979 (+38 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689200045056 (+77 ms) 2023-07-12 22:14:05,060 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-12 22:14:05,063 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 236 msec 2023-07-12 22:14:05,127 DEBUG [Listener at jenkins-hbase4.apache.org/41531] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 22:14:05,128 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-12 22:14:05,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 22:14:05,134 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37349] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1689200043640.74f4020a002ceda29dfc0f056b6181c6. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 22:14:05,135 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34497] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1689200043640.c03edf1239e85b41a507c640b5ec3c95. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 22:14:05,140 DEBUG [Listener at jenkins-hbase4.apache.org/41531] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-12 22:14:05,140 DEBUG [Listener at jenkins-hbase4.apache.org/41531] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1689200043640.74f4020a002ceda29dfc0f056b6181c6. 2023-07-12 22:14:05,140 INFO [Listener at jenkins-hbase4.apache.org/41531] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 22:14:05,161 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 22:14:05,161 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689200045161 (current time:1689200045161). 2023-07-12 22:14:05,161 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 22:14:05,162 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] zookeeper.ReadOnlyZKClient(139): Connect 0x5b703f3a to 127.0.0.1:62393 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 22:14:05,173 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@59a67d15, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 22:14:05,176 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 22:14:05,180 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55964, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 22:14:05,181 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5b703f3a to 127.0.0.1:62393 2023-07-12 22:14:05,181 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 22:14:05,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] zookeeper.ReadOnlyZKClient(139): Connect 0x6b1c027c to 127.0.0.1:62393 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 22:14:05,198 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5bebf433, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 22:14:05,200 DEBUG [hconnection-0x1fcc6242-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 22:14:05,201 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55972, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 22:14:05,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 22:14:05,208 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40110, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 22:14:05,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6b1c027c to 127.0.0.1:62393 2023-07-12 22:14:05,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 22:14:05,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-12 22:14:05,211 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 22:14:05,211 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 22:14:05,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-12 22:14:05,215 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-12 22:14:05,216 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689200645216 2023-07-12 22:14:05,216 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-12 22:14:05,216 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 22:14:05,217 DEBUG [Listener at jenkins-hbase4.apache.org/41531] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 22:14:05,217 DEBUG [Listener at jenkins-hbase4.apache.org/41531] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 22:14:05,218 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-12 22:14:05,218 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-12 22:14:05,220 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 5 msec 2023-07-12 22:14:05,221 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-12 22:14:05,222 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689200645222 2023-07-12 22:14:05,236 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-07-12 22:14:05,236 INFO [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-07-12 22:14:05,236 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 22:14:05,237 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-07-12 22:14:05,237 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-12 22:14:05,238 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 22:14:05,238 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-12 22:14:05,239 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:14:05,239 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:14:05,239 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:14:05,239 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:14:05,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:14:05,239 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:14:05,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:14:05,239 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:14:05,240 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:14:05,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:14:05,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-12 22:14:05,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-12 22:14:05,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-12 22:14:05,240 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 22:14:05,241 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:14:05,241 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:05,241 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 22:14:05,241 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 22:14:05,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-12 22:14:05,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-12 22:14:05,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-12 22:14:05,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-12 22:14:05,241 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-12 22:14:05,241 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-12 22:14:05,241 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:05,241 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 22:14:05,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-12 22:14:05,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-12 22:14:05,241 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-12 22:14:05,242 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-12 22:14:05,242 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-12 22:14:05,242 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-12 22:14:05,242 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-12 22:14:05,242 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 22:14:05,242 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 22:14:05,242 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-12 22:14:05,243 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-12 22:14:05,243 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-12 22:14:05,243 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-12 22:14:05,244 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-12 22:14:05,244 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40411,1689200016125' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-12 22:14:05,243 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34497,1689200016186' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-12 22:14:05,243 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-12 22:14:05,244 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 22:14:05,245 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-12 22:14:05,245 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-12 22:14:05,245 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37349,1689200016037' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-12 22:14:05,247 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 22:14:05,248 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:14:05,248 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 22:14:05,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:14:05,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 22:14:05,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 22:14:05,249 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:05,249 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 22:14:05,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 22:14:05,249 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 22:14:05,249 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 22:14:05,249 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 22:14:05,249 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 22:14:05,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 22:14:05,250 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 22:14:05,250 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 22:14:05,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-12 22:14:05,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:14:05,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:14:05,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:05,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 22:14:05,252 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34497,1689200016186' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-12 22:14:05,252 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@35018e62[Count = 1] remaining members to acquire global barrier 2023-07-12 22:14:05,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:05,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 22:14:05,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 22:14:05,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 22:14:05,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 22:14:05,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-12 22:14:05,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:14:05,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:14:05,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:05,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 22:14:05,254 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37349,1689200016037' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-12 22:14:05,255 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@35018e62[Count = 0] remaining members to acquire global barrier 2023-07-12 22:14:05,255 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-12 22:14:05,255 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 22:14:05,256 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 22:14:05,256 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 22:14:05,256 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 22:14:05,256 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 22:14:05,256 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 22:14:05,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 22:14:05,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 22:14:05,256 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 22:14:05,256 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-12 22:14:05,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 22:14:05,256 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:14:05,256 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-12 22:14:05,256 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-12 22:14:05,256 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-12 22:14:05,257 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40411,1689200016125' in zk 2023-07-12 22:14:05,257 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:05,257 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 22:14:05,257 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 22:14:05,257 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 22:14:05,257 DEBUG [rs(jenkins-hbase4.apache.org,34497,1689200016186)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689200043640.c03edf1239e85b41a507c640b5ec3c95. 2023-07-12 22:14:05,257 DEBUG [rs(jenkins-hbase4.apache.org,34497,1689200016186)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689200043640.c03edf1239e85b41a507c640b5ec3c95. started... 2023-07-12 22:14:05,258 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 22:14:05,258 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 22:14:05,258 DEBUG [rs(jenkins-hbase4.apache.org,37349,1689200016037)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689200043640.74f4020a002ceda29dfc0f056b6181c6. 2023-07-12 22:14:05,258 DEBUG [rs(jenkins-hbase4.apache.org,37349,1689200016037)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689200043640.74f4020a002ceda29dfc0f056b6181c6. started... 2023-07-12 22:14:05,258 INFO [rs(jenkins-hbase4.apache.org,34497,1689200016186)-snapshot-pool-0] regionserver.HRegion(2745): Flushing c03edf1239e85b41a507c640b5ec3c95 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-07-12 22:14:05,258 INFO [rs(jenkins-hbase4.apache.org,37349,1689200016037)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 74f4020a002ceda29dfc0f056b6181c6 1/1 column families, dataSize=333 B heapSize=976 B 2023-07-12 22:14:05,259 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-12 22:14:05,259 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 22:14:05,259 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-12 22:14:05,309 INFO [rs(jenkins-hbase4.apache.org,37349,1689200016037)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230712d560ee3d45a846548ba1701a21433a3b to hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230712d560ee3d45a846548ba1701a21433a3b 2023-07-12 22:14:05,311 INFO [rs(jenkins-hbase4.apache.org,34497,1689200016186)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230712ef32efb7052742439b29009f184e581d to hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230712ef32efb7052742439b29009f184e581d 2023-07-12 22:14:05,317 DEBUG [Listener at jenkins-hbase4.apache.org/41531] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 22:14:05,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-12 22:14:05,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-12 22:14:05,319 DEBUG [Listener at jenkins-hbase4.apache.org/41531] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 22:14:05,349 INFO [rs(jenkins-hbase4.apache.org,37349,1689200016037)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testExportFileSystemState/74f4020a002ceda29dfc0f056b6181c6/.tmp/cf/6346053df82149108fbbffba07704062 2023-07-12 22:14:05,355 INFO [rs(jenkins-hbase4.apache.org,34497,1689200016186)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testExportFileSystemState/c03edf1239e85b41a507c640b5ec3c95/.tmp/cf/32918f824d3445ad8e06ce072c16dc54 2023-07-12 22:14:05,360 DEBUG [rs(jenkins-hbase4.apache.org,37349,1689200016037)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testExportFileSystemState/74f4020a002ceda29dfc0f056b6181c6/.tmp/cf/6346053df82149108fbbffba07704062 as hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testExportFileSystemState/74f4020a002ceda29dfc0f056b6181c6/cf/6346053df82149108fbbffba07704062 2023-07-12 22:14:05,376 INFO [rs(jenkins-hbase4.apache.org,37349,1689200016037)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testExportFileSystemState/74f4020a002ceda29dfc0f056b6181c6/cf/6346053df82149108fbbffba07704062, entries=5, sequenceid=6, filesize=5.7 K 2023-07-12 22:14:05,377 INFO [rs(jenkins-hbase4.apache.org,37349,1689200016037)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for 74f4020a002ceda29dfc0f056b6181c6 in 119ms, sequenceid=6, compaction requested=false 2023-07-12 22:14:05,377 DEBUG [rs(jenkins-hbase4.apache.org,37349,1689200016037)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-07-12 22:14:05,377 DEBUG [rs(jenkins-hbase4.apache.org,37349,1689200016037)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 74f4020a002ceda29dfc0f056b6181c6: 2023-07-12 22:14:05,378 DEBUG [rs(jenkins-hbase4.apache.org,37349,1689200016037)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689200043640.74f4020a002ceda29dfc0f056b6181c6.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-12 22:14:05,378 DEBUG [rs(jenkins-hbase4.apache.org,37349,1689200016037)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 22:14:05,378 DEBUG [rs(jenkins-hbase4.apache.org,37349,1689200016037)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testExportFileSystemState/74f4020a002ceda29dfc0f056b6181c6/cf/6346053df82149108fbbffba07704062] hfiles 2023-07-12 22:14:05,378 DEBUG [rs(jenkins-hbase4.apache.org,37349,1689200016037)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testExportFileSystemState/74f4020a002ceda29dfc0f056b6181c6/cf/6346053df82149108fbbffba07704062 for snapshot=snaptb0-testExportFileSystemState 2023-07-12 22:14:05,382 DEBUG [rs(jenkins-hbase4.apache.org,34497,1689200016186)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testExportFileSystemState/c03edf1239e85b41a507c640b5ec3c95/.tmp/cf/32918f824d3445ad8e06ce072c16dc54 as hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testExportFileSystemState/c03edf1239e85b41a507c640b5ec3c95/cf/32918f824d3445ad8e06ce072c16dc54 2023-07-12 22:14:05,389 INFO [rs(jenkins-hbase4.apache.org,34497,1689200016186)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testExportFileSystemState/c03edf1239e85b41a507c640b5ec3c95/cf/32918f824d3445ad8e06ce072c16dc54, entries=45, sequenceid=6, filesize=12.5 K 2023-07-12 22:14:05,390 INFO [rs(jenkins-hbase4.apache.org,34497,1689200016186)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for c03edf1239e85b41a507c640b5ec3c95 in 132ms, sequenceid=6, compaction requested=false 2023-07-12 22:14:05,399 DEBUG [rs(jenkins-hbase4.apache.org,34497,1689200016186)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c03edf1239e85b41a507c640b5ec3c95: 2023-07-12 22:14:05,399 DEBUG [rs(jenkins-hbase4.apache.org,34497,1689200016186)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689200043640.c03edf1239e85b41a507c640b5ec3c95.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-12 22:14:05,399 DEBUG [rs(jenkins-hbase4.apache.org,34497,1689200016186)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 22:14:05,399 DEBUG [rs(jenkins-hbase4.apache.org,34497,1689200016186)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testExportFileSystemState/c03edf1239e85b41a507c640b5ec3c95/cf/32918f824d3445ad8e06ce072c16dc54] hfiles 2023-07-12 22:14:05,399 DEBUG [rs(jenkins-hbase4.apache.org,34497,1689200016186)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testExportFileSystemState/c03edf1239e85b41a507c640b5ec3c95/cf/32918f824d3445ad8e06ce072c16dc54 for snapshot=snaptb0-testExportFileSystemState 2023-07-12 22:14:05,402 DEBUG [rs(jenkins-hbase4.apache.org,37349,1689200016037)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689200043640.74f4020a002ceda29dfc0f056b6181c6. completed. 2023-07-12 22:14:05,402 DEBUG [rs(jenkins-hbase4.apache.org,37349,1689200016037)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689200043640.74f4020a002ceda29dfc0f056b6181c6. 2023-07-12 22:14:05,402 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 22:14:05,402 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 22:14:05,402 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:05,402 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-12 22:14:05,402 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,37349,1689200016037' in zk 2023-07-12 22:14:05,407 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-12 22:14:05,407 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:05,407 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 22:14:05,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:05,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 22:14:05,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 22:14:05,407 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-12 22:14:05,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 22:14:05,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 22:14:05,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-12 22:14:05,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:14:05,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:14:05,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:05,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 22:14:05,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-12 22:14:05,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:14:05,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:05,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,37349,1689200016037': 2023-07-12 22:14:05,412 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37349,1689200016037' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-12 22:14:05,421 DEBUG [rs(jenkins-hbase4.apache.org,34497,1689200016186)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689200043640.c03edf1239e85b41a507c640b5ec3c95. completed. 2023-07-12 22:14:05,421 DEBUG [rs(jenkins-hbase4.apache.org,34497,1689200016186)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689200043640.c03edf1239e85b41a507c640b5ec3c95. 2023-07-12 22:14:05,421 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 22:14:05,421 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 22:14:05,421 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:14:05,421 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-12 22:14:05,421 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,34497,1689200016186' in zk 2023-07-12 22:14:05,423 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-12 22:14:05,423 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 22:14:05,423 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-12 22:14:05,424 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:14:05,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:14:05,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 22:14:05,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 22:14:05,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 22:14:05,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 22:14:05,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-12 22:14:05,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:14:05,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:14:05,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:05,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 22:14:05,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-12 22:14:05,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:14:05,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:14:05,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:05,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,34497,1689200016186': 2023-07-12 22:14:05,428 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34497,1689200016186' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-12 22:14:05,428 INFO [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-07-12 22:14:05,428 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 22:14:05,428 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 22:14:05,428 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-07-12 22:14:05,429 INFO [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 22:14:05,432 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 22:14:05,432 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 22:14:05,432 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 22:14:05,432 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 22:14:05,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 22:14:05,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 22:14:05,432 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:14:05,432 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 22:14:05,432 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:14:05,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 22:14:05,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 22:14:05,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 22:14:05,432 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 22:14:05,432 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:14:05,432 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:14:05,432 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:14:05,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:14:05,432 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 22:14:05,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 22:14:05,432 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:14:05,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:14:05,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 22:14:05,433 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:14:05,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 22:14:05,433 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:14:05,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:14:05,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 22:14:05,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-12 22:14:05,434 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:05,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 22:14:05,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 22:14:05,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-12 22:14:05,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:14:05,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:14:05,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:05,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 22:14:05,436 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:14:05,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-12 22:14:05,436 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:14:05,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:14:05,436 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:05,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:14:05,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:05,440 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:05,440 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-12 22:14:05,440 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:14:05,440 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:14:05,440 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:14:05,440 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:14:05,440 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:14:05,440 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-12 22:14:05,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:14:05,440 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:05,440 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 22:14:05,440 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:14:05,442 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:14:05,442 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:14:05,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:14:05,442 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:14:05,442 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:14:05,442 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 22:14:05,442 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:14:05,444 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:14:05,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:14:05,444 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:14:05,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:14:05,442 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-07-12 22:14:05,442 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:14:05,444 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-07-12 22:14:05,444 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 22:14:05,444 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:14:05,444 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-12 22:14:05,444 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:14:05,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:14:05,445 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-12 22:14:05,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:14:05,444 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 22:14:05,446 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230712ef32efb7052742439b29009f184e581d, hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230712d560ee3d45a846548ba1701a21433a3b] mob files 2023-07-12 22:14:05,446 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230712ef32efb7052742439b29009f184e581d 2023-07-12 22:14:05,446 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230712d560ee3d45a846548ba1701a21433a3b 2023-07-12 22:14:05,455 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-07-12 22:14:05,456 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-12 22:14:05,488 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-12 22:14:05,513 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-12 22:14:05,514 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-12 22:14:05,514 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-12 22:14:05,514 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689200045216Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1689200045455 (+239 ms)Consolidate snapshot: snaptb0-testExportFileSystemState at 1689200045455Loading Region manifests for snaptb0-testExportFileSystemState at 1689200045455Writing data manifest for snaptb0-testExportFileSystemState at 1689200045460 (+5 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1689200045479 (+19 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689200045513 (+34 ms) 2023-07-12 22:14:05,517 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-12 22:14:05,519 DEBUG [Listener at jenkins-hbase4.apache.org/41531] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 22:14:05,519 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 300 msec 2023-07-12 22:14:05,520 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-12 22:14:05,521 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 22:14:05,521 INFO [Listener at jenkins-hbase4.apache.org/41531] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/export-test/export-1689200045521 2023-07-12 22:14:05,521 INFO [Listener at jenkins-hbase4.apache.org/41531] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:34335, tgtDir=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/export-test/export-1689200045521, rawTgtDir=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/export-test/export-1689200045521, srcFsUri=hdfs://localhost:34335, srcDir=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967 2023-07-12 22:14:05,555 DEBUG [Listener at jenkins-hbase4.apache.org/41531] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:34335, inputRoot=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967 2023-07-12 22:14:05,555 DEBUG [Listener at jenkins-hbase4.apache.org/41531] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1604201016_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/export-test/export-1689200045521, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/export-test/export-1689200045521/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-12 22:14:05,556 INFO [Listener at jenkins-hbase4.apache.org/41531] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:34335, inputRoot=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967, snapshotDir=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-07-12 22:14:05,579 INFO [Listener at jenkins-hbase4.apache.org/41531] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/export-test/export-1689200045521/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-12 22:14:05,625 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-12 22:14:05,626 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-12 22:14:05,626 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-12 22:14:05,627 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-12 22:14:05,627 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-12 22:14:05,627 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-12 22:14:05,628 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-12 22:14:05,715 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/652e6e64-efb3-f860-57fa-f551f44ecb6b/hadoop-1073224223076097113.jar 2023-07-12 22:14:05,716 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-12 22:14:05,717 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-12 22:14:05,717 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-12 22:14:05,718 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-12 22:14:05,718 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-12 22:14:05,719 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-12 22:14:05,720 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-12 22:14:05,720 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-12 22:14:05,721 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-12 22:14:05,721 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-12 22:14:05,722 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-12 22:14:05,723 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-12 22:14:05,723 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-12 22:14:05,724 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-12 22:14:05,724 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-12 22:14:05,725 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-12 22:14:05,725 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 22:14:05,726 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 22:14:05,727 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 22:14:05,727 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 22:14:05,727 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 22:14:05,728 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 22:14:05,728 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 22:14:06,448 WARN [Listener at jenkins-hbase4.apache.org/41531] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-12 22:14:06,451 INFO [Listener at jenkins-hbase4.apache.org/41531] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-07-12 22:14:06,453 DEBUG [Listener at jenkins-hbase4.apache.org/41531] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-07-12 22:14:07,555 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 22:14:07,555 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 22:14:07,561 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689200025069_0001_000001 (auth:SIMPLE) 2023-07-12 22:14:07,976 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689200025069_0002_000001 (auth:SIMPLE) 2023-07-12 22:14:08,904 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-12 22:14:12,700 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689200025069_0002_000001 (auth:SIMPLE) 2023-07-12 22:14:14,938 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689200025069_0002_000001 (auth:SIMPLE) 2023-07-12 22:14:18,103 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689200025069_0002_000001 (auth:SIMPLE) 2023-07-12 22:14:19,665 INFO [Listener at jenkins-hbase4.apache.org/41531] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-12 22:14:19,667 INFO [Listener at jenkins-hbase4.apache.org/41531] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-12 22:14:19,677 INFO [Listener at jenkins-hbase4.apache.org/41531] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-07-12 22:14:19,677 INFO [Listener at jenkins-hbase4.apache.org/41531] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-12 22:14:19,678 INFO [Listener at jenkins-hbase4.apache.org/41531] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-12 22:14:19,678 DEBUG [Listener at jenkins-hbase4.apache.org/41531] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1346150702_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-12 22:14:19,678 DEBUG [Listener at jenkins-hbase4.apache.org/41531] snapshot.TestExportSnapshot(367): hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-12 22:14:19,678 DEBUG [Listener at jenkins-hbase4.apache.org/41531] snapshot.TestExportSnapshot(367): hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-12 22:14:19,678 DEBUG [Listener at jenkins-hbase4.apache.org/41531] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1346150702_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/export-test/export-1689200045521/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/export-test/export-1689200045521/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-12 22:14:19,679 DEBUG [Listener at jenkins-hbase4.apache.org/41531] snapshot.TestExportSnapshot(367): hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/export-test/export-1689200045521/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-12 22:14:19,679 DEBUG [Listener at jenkins-hbase4.apache.org/41531] snapshot.TestExportSnapshot(367): hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/export-test/export-1689200045521/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-12 22:14:19,686 INFO [Listener at jenkins-hbase4.apache.org/41531] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-07-12 22:14:19,687 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-07-12 22:14:19,690 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] procedure2.ProcedureExecutor(1029): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-07-12 22:14:19,695 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-12 22:14:19,695 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689200059695"}]},"ts":"1689200059695"} 2023-07-12 22:14:19,697 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-07-12 22:14:19,699 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-07-12 22:14:19,700 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=74f4020a002ceda29dfc0f056b6181c6, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=c03edf1239e85b41a507c640b5ec3c95, UNASSIGN}] 2023-07-12 22:14:19,702 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=74f4020a002ceda29dfc0f056b6181c6, UNASSIGN 2023-07-12 22:14:19,703 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=c03edf1239e85b41a507c640b5ec3c95, UNASSIGN 2023-07-12 22:14:19,704 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=c03edf1239e85b41a507c640b5ec3c95, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:14:19,704 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=74f4020a002ceda29dfc0f056b6181c6, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:19,704 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689200043640.c03edf1239e85b41a507c640b5ec3c95.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689200059704"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689200059704"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689200059704"}]},"ts":"1689200059704"} 2023-07-12 22:14:19,704 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689200043640.74f4020a002ceda29dfc0f056b6181c6.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689200059704"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689200059704"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689200059704"}]},"ts":"1689200059704"} 2023-07-12 22:14:19,706 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=39, ppid=38, state=RUNNABLE; CloseRegionProcedure c03edf1239e85b41a507c640b5ec3c95, server=jenkins-hbase4.apache.org,34497,1689200016186}] 2023-07-12 22:14:19,707 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=37, state=RUNNABLE; CloseRegionProcedure 74f4020a002ceda29dfc0f056b6181c6, server=jenkins-hbase4.apache.org,37349,1689200016037}] 2023-07-12 22:14:19,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-12 22:14:19,858 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close c03edf1239e85b41a507c640b5ec3c95 2023-07-12 22:14:19,859 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c03edf1239e85b41a507c640b5ec3c95, disabling compactions & flushes 2023-07-12 22:14:19,859 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689200043640.c03edf1239e85b41a507c640b5ec3c95. 2023-07-12 22:14:19,859 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689200043640.c03edf1239e85b41a507c640b5ec3c95. 2023-07-12 22:14:19,859 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689200043640.c03edf1239e85b41a507c640b5ec3c95. after waiting 0 ms 2023-07-12 22:14:19,859 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689200043640.c03edf1239e85b41a507c640b5ec3c95. 2023-07-12 22:14:19,863 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 74f4020a002ceda29dfc0f056b6181c6 2023-07-12 22:14:19,863 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 74f4020a002ceda29dfc0f056b6181c6, disabling compactions & flushes 2023-07-12 22:14:19,863 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689200043640.74f4020a002ceda29dfc0f056b6181c6. 2023-07-12 22:14:19,863 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689200043640.74f4020a002ceda29dfc0f056b6181c6. 2023-07-12 22:14:19,863 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689200043640.74f4020a002ceda29dfc0f056b6181c6. after waiting 0 ms 2023-07-12 22:14:19,863 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689200043640.74f4020a002ceda29dfc0f056b6181c6. 2023-07-12 22:14:19,887 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testExportFileSystemState/c03edf1239e85b41a507c640b5ec3c95/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 22:14:19,888 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 22:14:19,890 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689200043640.c03edf1239e85b41a507c640b5ec3c95. 2023-07-12 22:14:19,890 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c03edf1239e85b41a507c640b5ec3c95: 2023-07-12 22:14:19,894 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed c03edf1239e85b41a507c640b5ec3c95 2023-07-12 22:14:19,895 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=c03edf1239e85b41a507c640b5ec3c95, regionState=CLOSED 2023-07-12 22:14:19,895 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689200043640.c03edf1239e85b41a507c640b5ec3c95.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689200059895"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689200059895"}]},"ts":"1689200059895"} 2023-07-12 22:14:19,899 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=39, resume processing ppid=38 2023-07-12 22:14:19,900 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=38, state=SUCCESS; CloseRegionProcedure c03edf1239e85b41a507c640b5ec3c95, server=jenkins-hbase4.apache.org,34497,1689200016186 in 191 msec 2023-07-12 22:14:19,903 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=c03edf1239e85b41a507c640b5ec3c95, UNASSIGN in 200 msec 2023-07-12 22:14:19,907 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testExportFileSystemState/74f4020a002ceda29dfc0f056b6181c6/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 22:14:19,908 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 22:14:19,910 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689200043640.74f4020a002ceda29dfc0f056b6181c6. 2023-07-12 22:14:19,910 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 74f4020a002ceda29dfc0f056b6181c6: 2023-07-12 22:14:19,912 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 74f4020a002ceda29dfc0f056b6181c6 2023-07-12 22:14:19,913 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=74f4020a002ceda29dfc0f056b6181c6, regionState=CLOSED 2023-07-12 22:14:19,913 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689200043640.74f4020a002ceda29dfc0f056b6181c6.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689200059913"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689200059913"}]},"ts":"1689200059913"} 2023-07-12 22:14:19,922 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=37 2023-07-12 22:14:19,922 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=37, state=SUCCESS; CloseRegionProcedure 74f4020a002ceda29dfc0f056b6181c6, server=jenkins-hbase4.apache.org,37349,1689200016037 in 208 msec 2023-07-12 22:14:19,926 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=37, resume processing ppid=36 2023-07-12 22:14:19,926 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=74f4020a002ceda29dfc0f056b6181c6, UNASSIGN in 222 msec 2023-07-12 22:14:19,927 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689200059927"}]},"ts":"1689200059927"} 2023-07-12 22:14:19,929 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-07-12 22:14:19,931 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-07-12 22:14:19,944 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 254 msec 2023-07-12 22:14:19,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-12 22:14:19,998 INFO [Listener at jenkins-hbase4.apache.org/41531] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-07-12 22:14:19,999 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-07-12 22:14:20,000 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] procedure2.ProcedureExecutor(1029): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-12 22:14:20,003 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-12 22:14:20,004 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-07-12 22:14:20,005 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-12 22:14:20,006 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34497] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-07-12 22:14:20,009 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-12 22:14:20,009 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-12 22:14:20,009 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-12 22:14:20,010 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-12 22:14:20,010 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-12 22:14:20,010 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-12 22:14:20,010 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-12 22:14:20,010 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-12 22:14:20,012 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-12 22:14:20,012 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-12 22:14:20,012 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 22:14:20,012 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-12 22:14:20,012 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 22:14:20,012 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 22:14:20,013 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-12 22:14:20,013 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 22:14:20,013 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testExportFileSystemState/74f4020a002ceda29dfc0f056b6181c6 2023-07-12 22:14:20,013 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testExportFileSystemState/c03edf1239e85b41a507c640b5ec3c95 2023-07-12 22:14:20,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-12 22:14:20,016 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testExportFileSystemState/74f4020a002ceda29dfc0f056b6181c6/cf, FileablePath, hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testExportFileSystemState/74f4020a002ceda29dfc0f056b6181c6/recovered.edits] 2023-07-12 22:14:20,016 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testExportFileSystemState/c03edf1239e85b41a507c640b5ec3c95/cf, FileablePath, hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testExportFileSystemState/c03edf1239e85b41a507c640b5ec3c95/recovered.edits] 2023-07-12 22:14:20,021 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testExportFileSystemState/74f4020a002ceda29dfc0f056b6181c6/cf/6346053df82149108fbbffba07704062 to hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/archive/data/default/testtb-testExportFileSystemState/74f4020a002ceda29dfc0f056b6181c6/cf/6346053df82149108fbbffba07704062 2023-07-12 22:14:20,021 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testExportFileSystemState/c03edf1239e85b41a507c640b5ec3c95/cf/32918f824d3445ad8e06ce072c16dc54 to hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/archive/data/default/testtb-testExportFileSystemState/c03edf1239e85b41a507c640b5ec3c95/cf/32918f824d3445ad8e06ce072c16dc54 2023-07-12 22:14:20,025 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testExportFileSystemState/74f4020a002ceda29dfc0f056b6181c6/recovered.edits/9.seqid to hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/archive/data/default/testtb-testExportFileSystemState/74f4020a002ceda29dfc0f056b6181c6/recovered.edits/9.seqid 2023-07-12 22:14:20,026 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testExportFileSystemState/c03edf1239e85b41a507c640b5ec3c95/recovered.edits/9.seqid to hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/archive/data/default/testtb-testExportFileSystemState/c03edf1239e85b41a507c640b5ec3c95/recovered.edits/9.seqid 2023-07-12 22:14:20,026 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testExportFileSystemState/74f4020a002ceda29dfc0f056b6181c6 2023-07-12 22:14:20,027 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testExportFileSystemState/c03edf1239e85b41a507c640b5ec3c95 2023-07-12 22:14:20,027 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-12 22:14:20,027 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-07-12 22:14:20,028 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf] 2023-07-12 22:14:20,033 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230712ef32efb7052742439b29009f184e581d to hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230712ef32efb7052742439b29009f184e581d 2023-07-12 22:14:20,035 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230712d560ee3d45a846548ba1701a21433a3b to hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230712d560ee3d45a846548ba1701a21433a3b 2023-07-12 22:14:20,035 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-07-12 22:14:20,038 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-12 22:14:20,042 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-07-12 22:14:20,044 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-07-12 22:14:20,045 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-12 22:14:20,046 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-07-12 22:14:20,046 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1689200043640.74f4020a002ceda29dfc0f056b6181c6.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689200060046"}]},"ts":"9223372036854775807"} 2023-07-12 22:14:20,046 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1689200043640.c03edf1239e85b41a507c640b5ec3c95.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689200060046"}]},"ts":"9223372036854775807"} 2023-07-12 22:14:20,048 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-12 22:14:20,048 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 74f4020a002ceda29dfc0f056b6181c6, NAME => 'testtb-testExportFileSystemState,,1689200043640.74f4020a002ceda29dfc0f056b6181c6.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => c03edf1239e85b41a507c640b5ec3c95, NAME => 'testtb-testExportFileSystemState,1,1689200043640.c03edf1239e85b41a507c640b5ec3c95.', STARTKEY => '1', ENDKEY => ''}] 2023-07-12 22:14:20,048 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-07-12 22:14:20,048 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689200060048"}]},"ts":"9223372036854775807"} 2023-07-12 22:14:20,051 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-07-12 22:14:20,054 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-12 22:14:20,057 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 55 msec 2023-07-12 22:14:20,115 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-12 22:14:20,116 INFO [Listener at jenkins-hbase4.apache.org/41531] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-07-12 22:14:20,128 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-07-12 22:14:20,131 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:20,133 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-07-12 22:14:20,136 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-07-12 22:14:20,184 INFO [Listener at jenkins-hbase4.apache.org/41531] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=766 (was 752) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x407c7a8e-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x407c7a8e-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1346150702_17 at /127.0.0.1:57868 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1648313058_1 at /127.0.0.1:39418 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x407c7a8e-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-2024 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x407c7a8e-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1346150702_17 at /127.0.0.1:39446 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (337744187) connection to jenkins-hbase4.apache.org/172.31.14.131:36211 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1648313058_1 at /127.0.0.1:45992 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1346150702_17 at /127.0.0.1:46012 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=927 (was 923) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=430 (was 432), ProcessCount=180 (was 180), AvailableMemoryMB=4665 (was 4851) 2023-07-12 22:14:20,185 WARN [Listener at jenkins-hbase4.apache.org/41531] hbase.ResourceChecker(130): Thread=766 is superior to 500 2023-07-12 22:14:20,212 INFO [Listener at jenkins-hbase4.apache.org/41531] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=766, OpenFileDescriptor=927, MaxFileDescriptor=60000, SystemLoadAverage=430, ProcessCount=177, AvailableMemoryMB=4665 2023-07-12 22:14:20,213 WARN [Listener at jenkins-hbase4.apache.org/41531] hbase.ResourceChecker(130): Thread=766 is superior to 500 2023-07-12 22:14:20,236 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-12 22:14:20,238 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-07-12 22:14:20,240 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 22:14:20,241 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-07-12 22:14:20,241 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 22:14:20,242 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-12 22:14:20,244 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testConsecutiveExports/b4ca7a4a41d66f110e300fe516e45002 2023-07-12 22:14:20,244 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testConsecutiveExports/c227067987c2816c37608d6ae11a3c04 2023-07-12 22:14:20,245 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testConsecutiveExports/b4ca7a4a41d66f110e300fe516e45002 empty. 2023-07-12 22:14:20,245 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testConsecutiveExports/c227067987c2816c37608d6ae11a3c04 empty. 2023-07-12 22:14:20,245 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testConsecutiveExports/b4ca7a4a41d66f110e300fe516e45002 2023-07-12 22:14:20,245 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testConsecutiveExports/c227067987c2816c37608d6ae11a3c04 2023-07-12 22:14:20,245 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-12 22:14:20,255 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-07-12 22:14:20,257 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => c227067987c2816c37608d6ae11a3c04, NAME => 'testtb-testConsecutiveExports,1,1689200060236.c227067987c2816c37608d6ae11a3c04.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp 2023-07-12 22:14:20,257 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => b4ca7a4a41d66f110e300fe516e45002, NAME => 'testtb-testConsecutiveExports,,1689200060236.b4ca7a4a41d66f110e300fe516e45002.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp 2023-07-12 22:14:20,270 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689200060236.c227067987c2816c37608d6ae11a3c04.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 22:14:20,270 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689200060236.b4ca7a4a41d66f110e300fe516e45002.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 22:14:20,270 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing c227067987c2816c37608d6ae11a3c04, disabling compactions & flushes 2023-07-12 22:14:20,270 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing b4ca7a4a41d66f110e300fe516e45002, disabling compactions & flushes 2023-07-12 22:14:20,270 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689200060236.c227067987c2816c37608d6ae11a3c04. 2023-07-12 22:14:20,270 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689200060236.b4ca7a4a41d66f110e300fe516e45002. 2023-07-12 22:14:20,270 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689200060236.c227067987c2816c37608d6ae11a3c04. 2023-07-12 22:14:20,270 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689200060236.b4ca7a4a41d66f110e300fe516e45002. 2023-07-12 22:14:20,270 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689200060236.c227067987c2816c37608d6ae11a3c04. after waiting 0 ms 2023-07-12 22:14:20,270 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689200060236.b4ca7a4a41d66f110e300fe516e45002. after waiting 0 ms 2023-07-12 22:14:20,270 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689200060236.c227067987c2816c37608d6ae11a3c04. 2023-07-12 22:14:20,270 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689200060236.b4ca7a4a41d66f110e300fe516e45002. 2023-07-12 22:14:20,270 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689200060236.c227067987c2816c37608d6ae11a3c04. 2023-07-12 22:14:20,270 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689200060236.b4ca7a4a41d66f110e300fe516e45002. 2023-07-12 22:14:20,270 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for c227067987c2816c37608d6ae11a3c04: 2023-07-12 22:14:20,270 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for b4ca7a4a41d66f110e300fe516e45002: 2023-07-12 22:14:20,273 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 22:14:20,274 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689200060236.c227067987c2816c37608d6ae11a3c04.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689200060274"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689200060274"}]},"ts":"1689200060274"} 2023-07-12 22:14:20,274 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689200060236.b4ca7a4a41d66f110e300fe516e45002.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689200060274"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689200060274"}]},"ts":"1689200060274"} 2023-07-12 22:14:20,276 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-12 22:14:20,277 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 22:14:20,277 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689200060277"}]},"ts":"1689200060277"} 2023-07-12 22:14:20,279 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-07-12 22:14:20,282 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-12 22:14:20,283 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 22:14:20,283 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 22:14:20,283 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-12 22:14:20,283 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 22:14:20,284 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=b4ca7a4a41d66f110e300fe516e45002, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=c227067987c2816c37608d6ae11a3c04, ASSIGN}] 2023-07-12 22:14:20,286 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=b4ca7a4a41d66f110e300fe516e45002, ASSIGN 2023-07-12 22:14:20,286 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=c227067987c2816c37608d6ae11a3c04, ASSIGN 2023-07-12 22:14:20,287 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=b4ca7a4a41d66f110e300fe516e45002, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37349,1689200016037; forceNewPlan=false, retain=false 2023-07-12 22:14:20,287 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=c227067987c2816c37608d6ae11a3c04, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34497,1689200016186; forceNewPlan=false, retain=false 2023-07-12 22:14:20,343 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-12 22:14:20,437 INFO [jenkins-hbase4:43225] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-12 22:14:20,440 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=c227067987c2816c37608d6ae11a3c04, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:14:20,440 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=b4ca7a4a41d66f110e300fe516e45002, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:20,440 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689200060236.c227067987c2816c37608d6ae11a3c04.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689200060440"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689200060440"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689200060440"}]},"ts":"1689200060440"} 2023-07-12 22:14:20,440 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689200060236.b4ca7a4a41d66f110e300fe516e45002.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689200060440"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689200060440"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689200060440"}]},"ts":"1689200060440"} 2023-07-12 22:14:20,442 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE; OpenRegionProcedure c227067987c2816c37608d6ae11a3c04, server=jenkins-hbase4.apache.org,34497,1689200016186}] 2023-07-12 22:14:20,443 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=43, state=RUNNABLE; OpenRegionProcedure b4ca7a4a41d66f110e300fe516e45002, server=jenkins-hbase4.apache.org,37349,1689200016037}] 2023-07-12 22:14:20,544 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-12 22:14:20,598 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1689200060236.c227067987c2816c37608d6ae11a3c04. 2023-07-12 22:14:20,598 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c227067987c2816c37608d6ae11a3c04, NAME => 'testtb-testConsecutiveExports,1,1689200060236.c227067987c2816c37608d6ae11a3c04.', STARTKEY => '1', ENDKEY => ''} 2023-07-12 22:14:20,598 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1689200060236.c227067987c2816c37608d6ae11a3c04. service=AccessControlService 2023-07-12 22:14:20,598 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1689200060236.b4ca7a4a41d66f110e300fe516e45002. 2023-07-12 22:14:20,598 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 22:14:20,598 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b4ca7a4a41d66f110e300fe516e45002, NAME => 'testtb-testConsecutiveExports,,1689200060236.b4ca7a4a41d66f110e300fe516e45002.', STARTKEY => '', ENDKEY => '1'} 2023-07-12 22:14:20,598 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports c227067987c2816c37608d6ae11a3c04 2023-07-12 22:14:20,599 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689200060236.c227067987c2816c37608d6ae11a3c04.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 22:14:20,599 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c227067987c2816c37608d6ae11a3c04 2023-07-12 22:14:20,599 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1689200060236.b4ca7a4a41d66f110e300fe516e45002. service=AccessControlService 2023-07-12 22:14:20,599 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c227067987c2816c37608d6ae11a3c04 2023-07-12 22:14:20,599 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 22:14:20,599 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports b4ca7a4a41d66f110e300fe516e45002 2023-07-12 22:14:20,599 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689200060236.b4ca7a4a41d66f110e300fe516e45002.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 22:14:20,599 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b4ca7a4a41d66f110e300fe516e45002 2023-07-12 22:14:20,599 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b4ca7a4a41d66f110e300fe516e45002 2023-07-12 22:14:20,600 INFO [StoreOpener-c227067987c2816c37608d6ae11a3c04-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region c227067987c2816c37608d6ae11a3c04 2023-07-12 22:14:20,600 INFO [StoreOpener-b4ca7a4a41d66f110e300fe516e45002-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region b4ca7a4a41d66f110e300fe516e45002 2023-07-12 22:14:20,601 DEBUG [StoreOpener-c227067987c2816c37608d6ae11a3c04-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testConsecutiveExports/c227067987c2816c37608d6ae11a3c04/cf 2023-07-12 22:14:20,601 DEBUG [StoreOpener-c227067987c2816c37608d6ae11a3c04-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testConsecutiveExports/c227067987c2816c37608d6ae11a3c04/cf 2023-07-12 22:14:20,601 DEBUG [StoreOpener-b4ca7a4a41d66f110e300fe516e45002-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testConsecutiveExports/b4ca7a4a41d66f110e300fe516e45002/cf 2023-07-12 22:14:20,602 DEBUG [StoreOpener-b4ca7a4a41d66f110e300fe516e45002-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testConsecutiveExports/b4ca7a4a41d66f110e300fe516e45002/cf 2023-07-12 22:14:20,602 INFO [StoreOpener-c227067987c2816c37608d6ae11a3c04-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c227067987c2816c37608d6ae11a3c04 columnFamilyName cf 2023-07-12 22:14:20,602 INFO [StoreOpener-b4ca7a4a41d66f110e300fe516e45002-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b4ca7a4a41d66f110e300fe516e45002 columnFamilyName cf 2023-07-12 22:14:20,603 INFO [StoreOpener-c227067987c2816c37608d6ae11a3c04-1] regionserver.HStore(310): Store=c227067987c2816c37608d6ae11a3c04/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 22:14:20,604 INFO [StoreOpener-b4ca7a4a41d66f110e300fe516e45002-1] regionserver.HStore(310): Store=b4ca7a4a41d66f110e300fe516e45002/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 22:14:20,604 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testConsecutiveExports/c227067987c2816c37608d6ae11a3c04 2023-07-12 22:14:20,605 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testConsecutiveExports/b4ca7a4a41d66f110e300fe516e45002 2023-07-12 22:14:20,605 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testConsecutiveExports/c227067987c2816c37608d6ae11a3c04 2023-07-12 22:14:20,605 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testConsecutiveExports/b4ca7a4a41d66f110e300fe516e45002 2023-07-12 22:14:20,608 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c227067987c2816c37608d6ae11a3c04 2023-07-12 22:14:20,608 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b4ca7a4a41d66f110e300fe516e45002 2023-07-12 22:14:20,610 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testConsecutiveExports/b4ca7a4a41d66f110e300fe516e45002/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 22:14:20,610 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testConsecutiveExports/c227067987c2816c37608d6ae11a3c04/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 22:14:20,610 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b4ca7a4a41d66f110e300fe516e45002; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69936876, jitterRate=0.0421406626701355}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 22:14:20,610 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b4ca7a4a41d66f110e300fe516e45002: 2023-07-12 22:14:20,610 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c227067987c2816c37608d6ae11a3c04; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68948697, jitterRate=0.027415648102760315}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 22:14:20,610 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c227067987c2816c37608d6ae11a3c04: 2023-07-12 22:14:20,611 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1689200060236.b4ca7a4a41d66f110e300fe516e45002., pid=46, masterSystemTime=1689200060595 2023-07-12 22:14:20,611 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1689200060236.c227067987c2816c37608d6ae11a3c04., pid=45, masterSystemTime=1689200060594 2023-07-12 22:14:20,613 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1689200060236.c227067987c2816c37608d6ae11a3c04. 2023-07-12 22:14:20,613 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1689200060236.c227067987c2816c37608d6ae11a3c04. 2023-07-12 22:14:20,613 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=c227067987c2816c37608d6ae11a3c04, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:14:20,613 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1689200060236.b4ca7a4a41d66f110e300fe516e45002. 2023-07-12 22:14:20,613 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1689200060236.c227067987c2816c37608d6ae11a3c04.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689200060613"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689200060613"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689200060613"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689200060613"}]},"ts":"1689200060613"} 2023-07-12 22:14:20,613 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1689200060236.b4ca7a4a41d66f110e300fe516e45002. 2023-07-12 22:14:20,614 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=b4ca7a4a41d66f110e300fe516e45002, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:20,614 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1689200060236.b4ca7a4a41d66f110e300fe516e45002.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689200060614"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689200060614"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689200060614"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689200060614"}]},"ts":"1689200060614"} 2023-07-12 22:14:20,617 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=44 2023-07-12 22:14:20,618 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=44, state=SUCCESS; OpenRegionProcedure c227067987c2816c37608d6ae11a3c04, server=jenkins-hbase4.apache.org,34497,1689200016186 in 173 msec 2023-07-12 22:14:20,619 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=43 2023-07-12 22:14:20,619 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=43, state=SUCCESS; OpenRegionProcedure b4ca7a4a41d66f110e300fe516e45002, server=jenkins-hbase4.apache.org,37349,1689200016037 in 173 msec 2023-07-12 22:14:20,619 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=c227067987c2816c37608d6ae11a3c04, ASSIGN in 334 msec 2023-07-12 22:14:20,621 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=43, resume processing ppid=42 2023-07-12 22:14:20,621 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=b4ca7a4a41d66f110e300fe516e45002, ASSIGN in 335 msec 2023-07-12 22:14:20,622 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 22:14:20,622 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689200060622"}]},"ts":"1689200060622"} 2023-07-12 22:14:20,624 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-07-12 22:14:20,626 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 22:14:20,626 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-07-12 22:14:20,628 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34497] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-12 22:14:20,629 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 22:14:20,630 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 22:14:20,630 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 22:14:20,629 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 22:14:20,631 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-12 22:14:20,631 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-12 22:14:20,631 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-12 22:14:20,631 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-12 22:14:20,633 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 395 msec 2023-07-12 22:14:20,846 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-12 22:14:20,846 INFO [Listener at jenkins-hbase4.apache.org/41531] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-07-12 22:14:20,849 DEBUG [Listener at jenkins-hbase4.apache.org/41531] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-12 22:14:20,849 DEBUG [Listener at jenkins-hbase4.apache.org/41531] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1689200060236.b4ca7a4a41d66f110e300fe516e45002. 2023-07-12 22:14:20,851 INFO [Listener at jenkins-hbase4.apache.org/41531] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 22:14:20,870 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-12 22:14:20,870 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689200060870 (current time:1689200060870). 2023-07-12 22:14:20,870 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 22:14:20,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] zookeeper.ReadOnlyZKClient(139): Connect 0x5850c1aa to 127.0.0.1:62393 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 22:14:20,879 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@12b1def1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 22:14:20,880 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 22:14:20,883 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46394, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 22:14:20,884 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5850c1aa to 127.0.0.1:62393 2023-07-12 22:14:20,884 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 22:14:20,885 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] zookeeper.ReadOnlyZKClient(139): Connect 0x5dc8e49f to 127.0.0.1:62393 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 22:14:20,890 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3cb331d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 22:14:20,895 DEBUG [hconnection-0x1f9133c3-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 22:14:20,898 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46404, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 22:14:20,902 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 22:14:20,903 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34104, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 22:14:20,904 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5dc8e49f to 127.0.0.1:62393 2023-07-12 22:14:20,904 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 22:14:20,904 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-12 22:14:20,905 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 22:14:20,905 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-12 22:14:20,908 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] procedure2.ProcedureExecutor(1029): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-12 22:14:20,909 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-12 22:14:20,910 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689200660910 2023-07-12 22:14:20,910 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-12 22:14:20,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-12 22:14:20,912 DEBUG [Listener at jenkins-hbase4.apache.org/41531] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 22:14:20,912 DEBUG [Listener at jenkins-hbase4.apache.org/41531] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 22:14:20,912 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-12 22:14:20,913 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-12 22:14:20,914 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 6 msec 2023-07-12 22:14:20,915 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-12 22:14:20,916 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689200660916 2023-07-12 22:14:20,937 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:20,937 INFO [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-07-12 22:14:20,937 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 22:14:20,939 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-07-12 22:14:20,939 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-12 22:14:21,004 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-12 22:14:21,008 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:21,008 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:21,009 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:14:21,010 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:14:21,010 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:14:21,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:14:21,010 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:14:21,010 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:14:21,010 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:14:21,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:14:21,010 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:14:21,010 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:21,010 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:14:21,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:14:21,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:21,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:21,010 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:21,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:21,010 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 22:14:21,010 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:21,011 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:21,011 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:21,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-12 22:14:21,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:21,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-12 22:14:21,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:21,011 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-12 22:14:21,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-12 22:14:21,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:21,011 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-12 22:14:21,011 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-12 22:14:21,011 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:21,012 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-12 22:14:21,012 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:21,012 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:21,012 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-12 22:14:21,012 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-12 22:14:21,012 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 22:14:21,012 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 22:14:21,013 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-12 22:14:21,014 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-12 22:14:21,012 DEBUG [Listener at jenkins-hbase4.apache.org/41531] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 22:14:21,012 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 22:14:21,014 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34497,1689200016186' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-12 22:14:21,014 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-12 22:14:21,017 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-12 22:14:21,017 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-12 22:14:21,017 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-12 22:14:21,017 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37349,1689200016037' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-12 22:14:21,017 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40411,1689200016125' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-12 22:14:21,019 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-12 22:14:21,019 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:21,019 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-12 22:14:21,019 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:14:21,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:14:21,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 22:14:21,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 22:14:21,019 DEBUG [Listener at jenkins-hbase4.apache.org/41531] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 22:14:21,019 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:21,020 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:21,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 22:14:21,020 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:21,019 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:21,020 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 22:14:21,020 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:21,020 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 22:14:21,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 22:14:21,020 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:21,020 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 22:14:21,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:21,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:14:21,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:14:21,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:21,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 22:14:21,022 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34497,1689200016186' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-12 22:14:21,022 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1d8bd6cb[Count = 1] remaining members to acquire global barrier 2023-07-12 22:14:21,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:21,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 22:14:21,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 22:14:21,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 22:14:21,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 22:14:21,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:21,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:14:21,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:14:21,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:21,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 22:14:21,025 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37349,1689200016037' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-12 22:14:21,025 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1d8bd6cb[Count = 0] remaining members to acquire global barrier 2023-07-12 22:14:21,025 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-12 22:14:21,025 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:21,028 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:21,028 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:21,028 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:21,028 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:21,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:21,028 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:21,028 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-12 22:14:21,028 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:21,028 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-12 22:14:21,028 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:14:21,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:21,029 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,40411,1689200016125' in zk 2023-07-12 22:14:21,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:21,029 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-12 22:14:21,029 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-12 22:14:21,029 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:21,029 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 22:14:21,029 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 22:14:21,029 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 22:14:21,029 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 22:14:21,029 DEBUG [rs(jenkins-hbase4.apache.org,34497,1689200016186)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689200060236.c227067987c2816c37608d6ae11a3c04. 2023-07-12 22:14:21,029 DEBUG [rs(jenkins-hbase4.apache.org,37349,1689200016037)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689200060236.b4ca7a4a41d66f110e300fe516e45002. 2023-07-12 22:14:21,029 DEBUG [rs(jenkins-hbase4.apache.org,34497,1689200016186)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689200060236.c227067987c2816c37608d6ae11a3c04. started... 2023-07-12 22:14:21,029 DEBUG [rs(jenkins-hbase4.apache.org,37349,1689200016037)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689200060236.b4ca7a4a41d66f110e300fe516e45002. started... 2023-07-12 22:14:21,029 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 22:14:21,031 DEBUG [rs(jenkins-hbase4.apache.org,34497,1689200016186)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c227067987c2816c37608d6ae11a3c04: 2023-07-12 22:14:21,031 DEBUG [rs(jenkins-hbase4.apache.org,34497,1689200016186)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689200060236.c227067987c2816c37608d6ae11a3c04.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:21,031 DEBUG [rs(jenkins-hbase4.apache.org,34497,1689200016186)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 22:14:21,031 DEBUG [rs(jenkins-hbase4.apache.org,34497,1689200016186)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 22:14:21,032 DEBUG [rs(jenkins-hbase4.apache.org,37349,1689200016037)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b4ca7a4a41d66f110e300fe516e45002: 2023-07-12 22:14:21,032 DEBUG [rs(jenkins-hbase4.apache.org,37349,1689200016037)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689200060236.b4ca7a4a41d66f110e300fe516e45002.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:21,033 DEBUG [rs(jenkins-hbase4.apache.org,37349,1689200016037)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 22:14:21,033 DEBUG [rs(jenkins-hbase4.apache.org,37349,1689200016037)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 22:14:21,033 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-12 22:14:21,034 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 22:14:21,034 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-12 22:14:21,060 DEBUG [rs(jenkins-hbase4.apache.org,37349,1689200016037)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689200060236.b4ca7a4a41d66f110e300fe516e45002. completed. 2023-07-12 22:14:21,060 DEBUG [rs(jenkins-hbase4.apache.org,37349,1689200016037)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689200060236.b4ca7a4a41d66f110e300fe516e45002. 2023-07-12 22:14:21,061 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 22:14:21,061 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 22:14:21,061 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:21,061 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-12 22:14:21,061 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,37349,1689200016037' in zk 2023-07-12 22:14:21,063 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:21,063 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-12 22:14:21,063 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 22:14:21,063 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-12 22:14:21,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:21,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 22:14:21,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 22:14:21,065 DEBUG [rs(jenkins-hbase4.apache.org,34497,1689200016186)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689200060236.c227067987c2816c37608d6ae11a3c04. completed. 2023-07-12 22:14:21,065 DEBUG [rs(jenkins-hbase4.apache.org,34497,1689200016186)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689200060236.c227067987c2816c37608d6ae11a3c04. 2023-07-12 22:14:21,065 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 22:14:21,065 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 22:14:21,065 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:14:21,065 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-12 22:14:21,065 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,34497,1689200016186' in zk 2023-07-12 22:14:21,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 22:14:21,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 22:14:21,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:21,068 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:14:21,068 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-12 22:14:21,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:14:21,068 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 22:14:21,068 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-12 22:14:21,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:14:21,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:21,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 22:14:21,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:21,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:14:21,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:14:21,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:21,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,37349,1689200016037': 2023-07-12 22:14:21,075 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37349,1689200016037' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-12 22:14:21,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:14:21,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 22:14:21,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 22:14:21,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 22:14:21,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 22:14:21,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:21,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:14:21,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:14:21,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:21,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 22:14:21,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:21,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:14:21,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:14:21,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:21,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,34497,1689200016186': 2023-07-12 22:14:21,082 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34497,1689200016186' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-12 22:14:21,082 INFO [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-07-12 22:14:21,082 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 22:14:21,082 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 22:14:21,082 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:21,082 INFO [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 22:14:21,084 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:21,084 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:21,084 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:21,084 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:21,084 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:21,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:21,084 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:14:21,084 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:14:21,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:21,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 22:14:21,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 22:14:21,084 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:21,085 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:14:21,085 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:21,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:21,085 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:14:21,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:21,085 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:14:21,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:14:21,085 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:14:21,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 22:14:21,085 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:14:21,085 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:14:21,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:14:21,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:21,086 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:21,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:14:21,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:21,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:21,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:21,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 22:14:21,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:21,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:14:21,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:14:21,089 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:14:21,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:21,089 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:14:21,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 22:14:21,090 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:21,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:21,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:14:21,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:14:21,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:21,094 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:21,094 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:14:21,094 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:21,094 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:14:21,094 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 22:14:21,094 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:14:21,094 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:14:21,096 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:14:21,096 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:14:21,094 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:14:21,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:14:21,094 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:14:21,094 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:14:21,096 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:21,096 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:21,094 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:21,096 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:21,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:14:21,097 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:14:21,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:14:21,096 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:14:21,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:14:21,096 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:14:21,097 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:14:21,096 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-07-12 22:14:21,097 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:14:21,097 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:14:21,097 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:21,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:14:21,097 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-12 22:14:21,097 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:21,097 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:21,098 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:14:21,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:14:21,098 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-12 22:14:21,109 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:21,110 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:21,148 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:21,171 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-12 22:14:21,172 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:21,172 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:21,172 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689200060910Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1689200061109 (+199 ms)Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1689200061109Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1689200061109Writing data manifest for emptySnaptb0-testConsecutiveExports at 1689200061114 (+5 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1689200061133 (+19 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689200061171 (+38 ms) 2023-07-12 22:14:21,178 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-12 22:14:21,181 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 267 msec 2023-07-12 22:14:21,219 DEBUG [Listener at jenkins-hbase4.apache.org/41531] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 22:14:21,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-12 22:14:21,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 22:14:21,232 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37349] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1689200060236.b4ca7a4a41d66f110e300fe516e45002. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 22:14:21,233 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34497] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1689200060236.c227067987c2816c37608d6ae11a3c04. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 22:14:21,237 DEBUG [Listener at jenkins-hbase4.apache.org/41531] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-12 22:14:21,237 DEBUG [Listener at jenkins-hbase4.apache.org/41531] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1689200060236.b4ca7a4a41d66f110e300fe516e45002. 2023-07-12 22:14:21,238 INFO [Listener at jenkins-hbase4.apache.org/41531] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 22:14:21,250 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-12 22:14:21,250 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689200061250 (current time:1689200061250). 2023-07-12 22:14:21,250 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 22:14:21,251 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] zookeeper.ReadOnlyZKClient(139): Connect 0x53eb79fe to 127.0.0.1:62393 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 22:14:21,271 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7f53011, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 22:14:21,273 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 22:14:21,275 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46410, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 22:14:21,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x53eb79fe to 127.0.0.1:62393 2023-07-12 22:14:21,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 22:14:21,277 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] zookeeper.ReadOnlyZKClient(139): Connect 0x58a8119f to 127.0.0.1:62393 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 22:14:21,290 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5004b7fd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 22:14:21,293 DEBUG [hconnection-0x7e5f6054-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 22:14:21,298 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46418, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 22:14:21,303 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 22:14:21,306 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34106, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 22:14:21,308 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x58a8119f to 127.0.0.1:62393 2023-07-12 22:14:21,308 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 22:14:21,308 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-12 22:14:21,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 22:14:21,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-12 22:14:21,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-12 22:14:21,315 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-12 22:14:21,317 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689200661317 2023-07-12 22:14:21,317 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-12 22:14:21,317 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-12 22:14:21,317 DEBUG [Listener at jenkins-hbase4.apache.org/41531] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 22:14:21,319 DEBUG [Listener at jenkins-hbase4.apache.org/41531] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 22:14:21,321 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-12 22:14:21,321 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-12 22:14:21,323 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 10 msec 2023-07-12 22:14:21,324 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-12 22:14:21,325 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689200661325 2023-07-12 22:14:21,419 DEBUG [Listener at jenkins-hbase4.apache.org/41531] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 22:14:21,420 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-12 22:14:21,420 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-12 22:14:21,421 DEBUG [Listener at jenkins-hbase4.apache.org/41531] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 22:14:21,621 DEBUG [Listener at jenkins-hbase4.apache.org/41531] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 22:14:21,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-12 22:14:21,623 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-12 22:14:21,623 DEBUG [Listener at jenkins-hbase4.apache.org/41531] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-12 22:14:21,757 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-07-12 22:14:21,757 INFO [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-07-12 22:14:21,757 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 22:14:21,757 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-07-12 22:14:21,757 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-12 22:14:21,758 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 22:14:21,758 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-12 22:14:21,759 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:14:21,759 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:14:21,759 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:14:21,760 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:14:21,760 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:14:21,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:14:21,760 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:14:21,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:14:21,760 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:14:21,760 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:14:21,760 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:21,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:14:21,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-12 22:14:21,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-12 22:14:21,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-12 22:14:21,763 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:21,763 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 22:14:21,763 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 22:14:21,763 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 22:14:21,763 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 22:14:21,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-12 22:14:21,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-12 22:14:21,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-12 22:14:21,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-12 22:14:21,764 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-12 22:14:21,764 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-12 22:14:21,764 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-12 22:14:21,764 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-12 22:14:21,764 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 22:14:21,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-12 22:14:21,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-12 22:14:21,767 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-12 22:14:21,769 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-12 22:14:21,771 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-12 22:14:21,771 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 22:14:21,770 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-12 22:14:21,770 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-12 22:14:21,772 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-12 22:14:21,772 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-12 22:14:21,773 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-12 22:14:21,772 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 22:14:21,772 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-12 22:14:21,773 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37349,1689200016037' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-12 22:14:21,774 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-12 22:14:21,774 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-12 22:14:21,774 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40411,1689200016125' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-12 22:14:21,773 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34497,1689200016186' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-12 22:14:21,776 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 22:14:21,776 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:21,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:21,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 22:14:21,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 22:14:21,776 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:14:21,777 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 22:14:21,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 22:14:21,777 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 22:14:21,777 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 22:14:21,777 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 22:14:21,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 22:14:21,777 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 22:14:21,777 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 22:14:21,777 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 22:14:21,777 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 22:14:21,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-12 22:14:21,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:14:21,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:14:21,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:21,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 22:14:21,779 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37349,1689200016037' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-12 22:14:21,779 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@25a74da3[Count = 1] remaining members to acquire global barrier 2023-07-12 22:14:21,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:14:21,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 22:14:21,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 22:14:21,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 22:14:21,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 22:14:21,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-12 22:14:21,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:14:21,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:14:21,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:21,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 22:14:21,782 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34497,1689200016186' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-12 22:14:21,782 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@25a74da3[Count = 0] remaining members to acquire global barrier 2023-07-12 22:14:21,782 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-12 22:14:21,782 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 22:14:21,784 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 22:14:21,784 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 22:14:21,785 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 22:14:21,785 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 22:14:21,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 22:14:21,784 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 22:14:21,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 22:14:21,785 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-12 22:14:21,785 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-12 22:14:21,785 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 22:14:21,785 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:21,785 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-12 22:14:21,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 22:14:21,785 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 22:14:21,785 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-12 22:14:21,785 DEBUG [rs(jenkins-hbase4.apache.org,34497,1689200016186)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689200060236.c227067987c2816c37608d6ae11a3c04. 2023-07-12 22:14:21,785 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,40411,1689200016125' in zk 2023-07-12 22:14:21,785 DEBUG [rs(jenkins-hbase4.apache.org,34497,1689200016186)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689200060236.c227067987c2816c37608d6ae11a3c04. started... 2023-07-12 22:14:21,785 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 22:14:21,785 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:14:21,786 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 22:14:21,786 DEBUG [rs(jenkins-hbase4.apache.org,37349,1689200016037)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689200060236.b4ca7a4a41d66f110e300fe516e45002. 2023-07-12 22:14:21,785 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 22:14:21,786 DEBUG [rs(jenkins-hbase4.apache.org,37349,1689200016037)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689200060236.b4ca7a4a41d66f110e300fe516e45002. started... 2023-07-12 22:14:21,785 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 22:14:21,786 INFO [rs(jenkins-hbase4.apache.org,34497,1689200016186)-snapshot-pool-0] regionserver.HRegion(2745): Flushing c227067987c2816c37608d6ae11a3c04 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-07-12 22:14:21,786 INFO [rs(jenkins-hbase4.apache.org,37349,1689200016037)-snapshot-pool-0] regionserver.HRegion(2745): Flushing b4ca7a4a41d66f110e300fe516e45002 1/1 column families, dataSize=333 B heapSize=976 B 2023-07-12 22:14:21,787 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-12 22:14:21,788 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 22:14:21,788 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-12 22:14:21,821 INFO [rs(jenkins-hbase4.apache.org,34497,1689200016186)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023071277d634abbed646dba035c7daad9a06cd to hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023071277d634abbed646dba035c7daad9a06cd 2023-07-12 22:14:21,830 INFO [rs(jenkins-hbase4.apache.org,37349,1689200016037)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023071243e513ec515d4d6a86d42e0670d9c94b to hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e2023071243e513ec515d4d6a86d42e0670d9c94b 2023-07-12 22:14:21,923 DEBUG [Listener at jenkins-hbase4.apache.org/41531] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 22:14:21,924 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-12 22:14:21,924 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-12 22:14:21,925 DEBUG [Listener at jenkins-hbase4.apache.org/41531] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-12 22:14:22,236 INFO [rs(jenkins-hbase4.apache.org,34497,1689200016186)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testConsecutiveExports/c227067987c2816c37608d6ae11a3c04/.tmp/cf/cf472dfe85e54621b4639900022f94b0 2023-07-12 22:14:22,242 DEBUG [rs(jenkins-hbase4.apache.org,34497,1689200016186)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testConsecutiveExports/c227067987c2816c37608d6ae11a3c04/.tmp/cf/cf472dfe85e54621b4639900022f94b0 as hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testConsecutiveExports/c227067987c2816c37608d6ae11a3c04/cf/cf472dfe85e54621b4639900022f94b0 2023-07-12 22:14:22,247 INFO [rs(jenkins-hbase4.apache.org,34497,1689200016186)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testConsecutiveExports/c227067987c2816c37608d6ae11a3c04/cf/cf472dfe85e54621b4639900022f94b0, entries=45, sequenceid=6, filesize=12.4 K 2023-07-12 22:14:22,248 INFO [rs(jenkins-hbase4.apache.org,34497,1689200016186)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for c227067987c2816c37608d6ae11a3c04 in 462ms, sequenceid=6, compaction requested=false 2023-07-12 22:14:22,250 DEBUG [rs(jenkins-hbase4.apache.org,34497,1689200016186)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c227067987c2816c37608d6ae11a3c04: 2023-07-12 22:14:22,250 DEBUG [rs(jenkins-hbase4.apache.org,34497,1689200016186)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689200060236.c227067987c2816c37608d6ae11a3c04.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-12 22:14:22,250 DEBUG [rs(jenkins-hbase4.apache.org,34497,1689200016186)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 22:14:22,250 DEBUG [rs(jenkins-hbase4.apache.org,34497,1689200016186)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testConsecutiveExports/c227067987c2816c37608d6ae11a3c04/cf/cf472dfe85e54621b4639900022f94b0] hfiles 2023-07-12 22:14:22,250 DEBUG [rs(jenkins-hbase4.apache.org,34497,1689200016186)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testConsecutiveExports/c227067987c2816c37608d6ae11a3c04/cf/cf472dfe85e54621b4639900022f94b0 for snapshot=snaptb0-testConsecutiveExports 2023-07-12 22:14:22,256 INFO [rs(jenkins-hbase4.apache.org,37349,1689200016037)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testConsecutiveExports/b4ca7a4a41d66f110e300fe516e45002/.tmp/cf/92ef2de71d4e4b8695f91bc43de2131c 2023-07-12 22:14:22,259 DEBUG [rs(jenkins-hbase4.apache.org,34497,1689200016186)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689200060236.c227067987c2816c37608d6ae11a3c04. completed. 2023-07-12 22:14:22,259 DEBUG [rs(jenkins-hbase4.apache.org,34497,1689200016186)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689200060236.c227067987c2816c37608d6ae11a3c04. 2023-07-12 22:14:22,260 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 22:14:22,260 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 22:14:22,260 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:14:22,260 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-12 22:14:22,260 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,34497,1689200016186' in zk 2023-07-12 22:14:22,261 DEBUG [rs(jenkins-hbase4.apache.org,37349,1689200016037)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testConsecutiveExports/b4ca7a4a41d66f110e300fe516e45002/.tmp/cf/92ef2de71d4e4b8695f91bc43de2131c as hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testConsecutiveExports/b4ca7a4a41d66f110e300fe516e45002/cf/92ef2de71d4e4b8695f91bc43de2131c 2023-07-12 22:14:22,261 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:14:22,261 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-12 22:14:22,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:14:22,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 22:14:22,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 22:14:22,262 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 22:14:22,262 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-12 22:14:22,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 22:14:22,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 22:14:22,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-12 22:14:22,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:14:22,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:14:22,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:22,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 22:14:22,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-12 22:14:22,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:14:22,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:14:22,268 INFO [rs(jenkins-hbase4.apache.org,37349,1689200016037)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testConsecutiveExports/b4ca7a4a41d66f110e300fe516e45002/cf/92ef2de71d4e4b8695f91bc43de2131c, entries=5, sequenceid=6, filesize=5.7 K 2023-07-12 22:14:22,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,34497,1689200016186': 2023-07-12 22:14:22,268 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34497,1689200016186' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-12 22:14:22,271 INFO [rs(jenkins-hbase4.apache.org,37349,1689200016037)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for b4ca7a4a41d66f110e300fe516e45002 in 485ms, sequenceid=6, compaction requested=false 2023-07-12 22:14:22,271 DEBUG [rs(jenkins-hbase4.apache.org,37349,1689200016037)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b4ca7a4a41d66f110e300fe516e45002: 2023-07-12 22:14:22,271 DEBUG [rs(jenkins-hbase4.apache.org,37349,1689200016037)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689200060236.b4ca7a4a41d66f110e300fe516e45002.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-12 22:14:22,271 DEBUG [rs(jenkins-hbase4.apache.org,37349,1689200016037)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 22:14:22,271 DEBUG [rs(jenkins-hbase4.apache.org,37349,1689200016037)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testConsecutiveExports/b4ca7a4a41d66f110e300fe516e45002/cf/92ef2de71d4e4b8695f91bc43de2131c] hfiles 2023-07-12 22:14:22,271 DEBUG [rs(jenkins-hbase4.apache.org,37349,1689200016037)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testConsecutiveExports/b4ca7a4a41d66f110e300fe516e45002/cf/92ef2de71d4e4b8695f91bc43de2131c for snapshot=snaptb0-testConsecutiveExports 2023-07-12 22:14:22,283 DEBUG [rs(jenkins-hbase4.apache.org,37349,1689200016037)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689200060236.b4ca7a4a41d66f110e300fe516e45002. completed. 2023-07-12 22:14:22,283 DEBUG [rs(jenkins-hbase4.apache.org,37349,1689200016037)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689200060236.b4ca7a4a41d66f110e300fe516e45002. 2023-07-12 22:14:22,283 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 22:14:22,283 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 22:14:22,283 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:22,283 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-12 22:14:22,283 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,37349,1689200016037' in zk 2023-07-12 22:14:22,285 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-12 22:14:22,285 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:22,285 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 22:14:22,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:22,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 22:14:22,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 22:14:22,285 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-12 22:14:22,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 22:14:22,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 22:14:22,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-12 22:14:22,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:14:22,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:14:22,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:22,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 22:14:22,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-12 22:14:22,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:14:22,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:14:22,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:22,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,37349,1689200016037': 2023-07-12 22:14:22,290 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37349,1689200016037' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-12 22:14:22,290 INFO [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-07-12 22:14:22,290 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 22:14:22,290 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 22:14:22,290 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-07-12 22:14:22,290 INFO [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 22:14:22,293 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 22:14:22,293 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 22:14:22,293 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:14:22,293 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 22:14:22,293 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 22:14:22,293 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:14:22,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 22:14:22,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 22:14:22,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 22:14:22,293 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 22:14:22,293 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 22:14:22,294 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:14:22,294 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 22:14:22,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 22:14:22,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 22:14:22,294 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:14:22,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 22:14:22,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 22:14:22,294 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:14:22,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:14:22,294 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:14:22,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:14:22,295 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:14:22,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:14:22,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-12 22:14:22,295 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:14:22,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 22:14:22,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 22:14:22,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 22:14:22,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 22:14:22,295 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:22,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-12 22:14:22,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:14:22,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:14:22,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:22,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 22:14:22,297 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:14:22,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-12 22:14:22,298 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:14:22,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:14:22,298 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:22,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:14:22,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:22,305 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:14:22,305 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:22,305 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:14:22,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:14:22,305 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:14:22,305 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-12 22:14:22,305 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-07-12 22:14:22,305 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:14:22,305 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:14:22,305 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:14:22,305 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:14:22,305 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:14:22,305 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-07-12 22:14:22,305 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:14:22,305 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 22:14:22,305 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:14:22,305 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-12 22:14:22,307 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-12 22:14:22,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:14:22,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:14:22,305 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:14:22,307 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:22,307 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-12 22:14:22,308 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:14:22,308 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:14:22,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:14:22,307 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:14:22,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:14:22,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:14:22,307 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 22:14:22,308 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:14:22,308 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:14:22,308 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 22:14:22,308 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 22:14:22,309 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023071277d634abbed646dba035c7daad9a06cd, hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e2023071243e513ec515d4d6a86d42e0670d9c94b] mob files 2023-07-12 22:14:22,309 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023071277d634abbed646dba035c7daad9a06cd 2023-07-12 22:14:22,309 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e2023071243e513ec515d4d6a86d42e0670d9c94b 2023-07-12 22:14:22,321 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-07-12 22:14:22,322 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-12 22:14:22,340 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-12 22:14:22,358 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-12 22:14:22,358 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-12 22:14:22,359 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-12 22:14:22,359 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689200061317Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1689200062321 (+1004 ms)Consolidate snapshot: snaptb0-testConsecutiveExports at 1689200062321Loading Region manifests for snaptb0-testConsecutiveExports at 1689200062321Writing data manifest for snaptb0-testConsecutiveExports at 1689200062325 (+4 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1689200062332 (+7 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689200062358 (+26 ms) 2023-07-12 22:14:22,361 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-12 22:14:22,363 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 1.0420 sec 2023-07-12 22:14:22,425 DEBUG [Listener at jenkins-hbase4.apache.org/41531] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 22:14:22,426 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-12 22:14:22,426 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 22:14:22,426 INFO [Listener at jenkins-hbase4.apache.org/41531] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/652e6e64-efb3-f860-57fa-f551f44ecb6b/local-export-1689200062426 2023-07-12 22:14:22,426 INFO [Listener at jenkins-hbase4.apache.org/41531] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/652e6e64-efb3-f860-57fa-f551f44ecb6b/local-export-1689200062426, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/652e6e64-efb3-f860-57fa-f551f44ecb6b/local-export-1689200062426, srcFsUri=hdfs://localhost:34335, srcDir=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967 2023-07-12 22:14:22,449 DEBUG [Listener at jenkins-hbase4.apache.org/41531] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:34335, inputRoot=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967 2023-07-12 22:14:22,449 DEBUG [Listener at jenkins-hbase4.apache.org/41531] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@22f5bd14, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/652e6e64-efb3-f860-57fa-f551f44ecb6b/local-export-1689200062426, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/652e6e64-efb3-f860-57fa-f551f44ecb6b/local-export-1689200062426/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-12 22:14:22,449 INFO [Listener at jenkins-hbase4.apache.org/41531] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:34335, inputRoot=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967, snapshotDir=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-12 22:14:22,458 INFO [Listener at jenkins-hbase4.apache.org/41531] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/652e6e64-efb3-f860-57fa-f551f44ecb6b/local-export-1689200062426/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-12 22:14:22,471 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-12 22:14:22,471 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-12 22:14:22,472 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-12 22:14:22,472 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-12 22:14:22,472 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-12 22:14:22,473 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-12 22:14:22,473 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-12 22:14:22,541 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/652e6e64-efb3-f860-57fa-f551f44ecb6b/hadoop-8398258513181781682.jar 2023-07-12 22:14:22,542 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-12 22:14:22,542 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-12 22:14:22,543 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-12 22:14:22,543 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-12 22:14:22,543 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-12 22:14:22,543 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-12 22:14:22,544 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-12 22:14:22,544 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-12 22:14:22,545 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-12 22:14:22,545 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-12 22:14:22,545 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-12 22:14:22,546 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-12 22:14:22,546 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-12 22:14:22,546 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-12 22:14:22,547 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-12 22:14:22,547 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-12 22:14:22,548 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 22:14:22,548 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 22:14:22,548 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 22:14:22,549 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 22:14:22,549 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 22:14:22,549 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 22:14:22,550 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 22:14:22,928 WARN [Listener at jenkins-hbase4.apache.org/41531] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-12 22:14:22,930 INFO [Listener at jenkins-hbase4.apache.org/41531] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-12 22:14:22,932 DEBUG [Listener at jenkins-hbase4.apache.org/41531] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-07-12 22:14:24,284 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 22:14:24,284 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 22:14:24,287 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689200025069_0002_000001 (auth:SIMPLE) 2023-07-12 22:14:24,571 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689200025069_0003_000001 (auth:SIMPLE) 2023-07-12 22:14:25,485 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-12 22:14:29,283 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689200025069_0003_000001 (auth:SIMPLE) 2023-07-12 22:14:31,525 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689200025069_0003_000001 (auth:SIMPLE) 2023-07-12 22:14:34,481 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689200025069_0003_000001 (auth:SIMPLE) 2023-07-12 22:14:36,115 INFO [Listener at jenkins-hbase4.apache.org/41531] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-12 22:14:36,115 INFO [Listener at jenkins-hbase4.apache.org/41531] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-12 22:14:36,120 INFO [Listener at jenkins-hbase4.apache.org/41531] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-12 22:14:36,121 INFO [Listener at jenkins-hbase4.apache.org/41531] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-12 22:14:36,121 INFO [Listener at jenkins-hbase4.apache.org/41531] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-12 22:14:36,122 DEBUG [Listener at jenkins-hbase4.apache.org/41531] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1346150702_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-12 22:14:36,122 DEBUG [Listener at jenkins-hbase4.apache.org/41531] snapshot.TestExportSnapshot(367): hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-12 22:14:36,122 DEBUG [Listener at jenkins-hbase4.apache.org/41531] snapshot.TestExportSnapshot(367): hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-12 22:14:36,123 DEBUG [Listener at jenkins-hbase4.apache.org/41531] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@6f8e793c in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/652e6e64-efb3-f860-57fa-f551f44ecb6b/local-export-1689200062426/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/652e6e64-efb3-f860-57fa-f551f44ecb6b/local-export-1689200062426/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-12 22:14:36,123 DEBUG [Listener at jenkins-hbase4.apache.org/41531] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/652e6e64-efb3-f860-57fa-f551f44ecb6b/local-export-1689200062426/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-12 22:14:36,123 DEBUG [Listener at jenkins-hbase4.apache.org/41531] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/652e6e64-efb3-f860-57fa-f551f44ecb6b/local-export-1689200062426/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-12 22:14:36,125 INFO [Listener at jenkins-hbase4.apache.org/41531] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/652e6e64-efb3-f860-57fa-f551f44ecb6b/local-export-1689200062426, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/652e6e64-efb3-f860-57fa-f551f44ecb6b/local-export-1689200062426, srcFsUri=hdfs://localhost:34335, srcDir=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967 2023-07-12 22:14:36,159 DEBUG [Listener at jenkins-hbase4.apache.org/41531] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:34335, inputRoot=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967 2023-07-12 22:14:36,159 DEBUG [Listener at jenkins-hbase4.apache.org/41531] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@26365d5c, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/652e6e64-efb3-f860-57fa-f551f44ecb6b/local-export-1689200062426, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/652e6e64-efb3-f860-57fa-f551f44ecb6b/local-export-1689200062426/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-12 22:14:36,159 INFO [Listener at jenkins-hbase4.apache.org/41531] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:34335, inputRoot=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967, snapshotDir=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-12 22:14:36,187 INFO [Listener at jenkins-hbase4.apache.org/41531] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/652e6e64-efb3-f860-57fa-f551f44ecb6b/local-export-1689200062426/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-12 22:14:36,201 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-12 22:14:36,201 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-12 22:14:36,202 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-12 22:14:36,202 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-12 22:14:36,203 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-12 22:14:36,203 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-12 22:14:36,203 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-12 22:14:36,284 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/652e6e64-efb3-f860-57fa-f551f44ecb6b/hadoop-1253462112932483930.jar 2023-07-12 22:14:36,285 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-12 22:14:36,285 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-12 22:14:36,285 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-12 22:14:36,286 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-12 22:14:36,286 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-12 22:14:36,286 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-12 22:14:36,287 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-12 22:14:36,287 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-12 22:14:36,288 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-12 22:14:36,288 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-12 22:14:36,289 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-12 22:14:36,289 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-12 22:14:36,289 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-12 22:14:36,290 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-12 22:14:36,290 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-12 22:14:36,291 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-12 22:14:36,291 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 22:14:36,292 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 22:14:36,292 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 22:14:36,292 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 22:14:36,293 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 22:14:36,293 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 22:14:36,294 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 22:14:36,774 WARN [Listener at jenkins-hbase4.apache.org/41531] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-12 22:14:36,777 INFO [Listener at jenkins-hbase4.apache.org/41531] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-12 22:14:36,779 DEBUG [Listener at jenkins-hbase4.apache.org/41531] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-07-12 22:14:40,650 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 22:14:40,651 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 22:14:40,654 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689200025069_0003_000001 (auth:SIMPLE) 2023-07-12 22:14:41,301 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689200025069_0004_000001 (auth:SIMPLE) 2023-07-12 22:14:45,958 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689200025069_0004_000001 (auth:SIMPLE) 2023-07-12 22:14:48,211 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689200025069_0004_000001 (auth:SIMPLE) 2023-07-12 22:14:51,255 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689200025069_0004_000001 (auth:SIMPLE) 2023-07-12 22:14:52,978 INFO [Listener at jenkins-hbase4.apache.org/41531] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-12 22:14:52,978 INFO [Listener at jenkins-hbase4.apache.org/41531] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-12 22:14:52,982 INFO [Listener at jenkins-hbase4.apache.org/41531] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-12 22:14:52,982 INFO [Listener at jenkins-hbase4.apache.org/41531] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-12 22:14:52,983 INFO [Listener at jenkins-hbase4.apache.org/41531] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-12 22:14:52,983 DEBUG [Listener at jenkins-hbase4.apache.org/41531] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1346150702_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-12 22:14:52,987 DEBUG [Listener at jenkins-hbase4.apache.org/41531] snapshot.TestExportSnapshot(367): hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-12 22:14:52,987 DEBUG [Listener at jenkins-hbase4.apache.org/41531] snapshot.TestExportSnapshot(367): hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-12 22:14:52,987 DEBUG [Listener at jenkins-hbase4.apache.org/41531] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@6f8e793c in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/652e6e64-efb3-f860-57fa-f551f44ecb6b/local-export-1689200062426/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/652e6e64-efb3-f860-57fa-f551f44ecb6b/local-export-1689200062426/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-12 22:14:52,987 DEBUG [Listener at jenkins-hbase4.apache.org/41531] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/652e6e64-efb3-f860-57fa-f551f44ecb6b/local-export-1689200062426/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-12 22:14:52,987 DEBUG [Listener at jenkins-hbase4.apache.org/41531] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/652e6e64-efb3-f860-57fa-f551f44ecb6b/local-export-1689200062426/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-12 22:14:53,001 INFO [Listener at jenkins-hbase4.apache.org/41531] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-07-12 22:14:53,002 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-07-12 22:14:53,003 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] procedure2.ProcedureExecutor(1029): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-07-12 22:14:53,006 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-12 22:14:53,007 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689200093007"}]},"ts":"1689200093007"} 2023-07-12 22:14:53,009 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-07-12 22:14:53,011 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-07-12 22:14:53,012 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=b4ca7a4a41d66f110e300fe516e45002, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=c227067987c2816c37608d6ae11a3c04, UNASSIGN}] 2023-07-12 22:14:53,013 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=c227067987c2816c37608d6ae11a3c04, UNASSIGN 2023-07-12 22:14:53,015 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=b4ca7a4a41d66f110e300fe516e45002, UNASSIGN 2023-07-12 22:14:53,016 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=c227067987c2816c37608d6ae11a3c04, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:14:53,017 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689200060236.c227067987c2816c37608d6ae11a3c04.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689200093016"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689200093016"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689200093016"}]},"ts":"1689200093016"} 2023-07-12 22:14:53,017 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=b4ca7a4a41d66f110e300fe516e45002, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:53,017 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689200060236.b4ca7a4a41d66f110e300fe516e45002.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689200093017"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689200093017"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689200093017"}]},"ts":"1689200093017"} 2023-07-12 22:14:53,020 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=54, ppid=53, state=RUNNABLE; CloseRegionProcedure c227067987c2816c37608d6ae11a3c04, server=jenkins-hbase4.apache.org,34497,1689200016186}] 2023-07-12 22:14:53,021 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=55, ppid=52, state=RUNNABLE; CloseRegionProcedure b4ca7a4a41d66f110e300fe516e45002, server=jenkins-hbase4.apache.org,37349,1689200016037}] 2023-07-12 22:14:53,108 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-12 22:14:53,179 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close b4ca7a4a41d66f110e300fe516e45002 2023-07-12 22:14:53,179 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close c227067987c2816c37608d6ae11a3c04 2023-07-12 22:14:53,179 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c227067987c2816c37608d6ae11a3c04, disabling compactions & flushes 2023-07-12 22:14:53,179 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b4ca7a4a41d66f110e300fe516e45002, disabling compactions & flushes 2023-07-12 22:14:53,179 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689200060236.c227067987c2816c37608d6ae11a3c04. 2023-07-12 22:14:53,179 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689200060236.b4ca7a4a41d66f110e300fe516e45002. 2023-07-12 22:14:53,179 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689200060236.b4ca7a4a41d66f110e300fe516e45002. 2023-07-12 22:14:53,179 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689200060236.c227067987c2816c37608d6ae11a3c04. 2023-07-12 22:14:53,179 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689200060236.b4ca7a4a41d66f110e300fe516e45002. after waiting 0 ms 2023-07-12 22:14:53,179 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689200060236.b4ca7a4a41d66f110e300fe516e45002. 2023-07-12 22:14:53,179 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689200060236.c227067987c2816c37608d6ae11a3c04. after waiting 0 ms 2023-07-12 22:14:53,179 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689200060236.c227067987c2816c37608d6ae11a3c04. 2023-07-12 22:14:53,192 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testConsecutiveExports/c227067987c2816c37608d6ae11a3c04/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 22:14:53,192 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testConsecutiveExports/b4ca7a4a41d66f110e300fe516e45002/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 22:14:53,193 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 22:14:53,194 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689200060236.c227067987c2816c37608d6ae11a3c04. 2023-07-12 22:14:53,194 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 22:14:53,194 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c227067987c2816c37608d6ae11a3c04: 2023-07-12 22:14:53,194 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689200060236.b4ca7a4a41d66f110e300fe516e45002. 2023-07-12 22:14:53,195 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b4ca7a4a41d66f110e300fe516e45002: 2023-07-12 22:14:53,196 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed c227067987c2816c37608d6ae11a3c04 2023-07-12 22:14:53,198 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=c227067987c2816c37608d6ae11a3c04, regionState=CLOSED 2023-07-12 22:14:53,198 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689200060236.c227067987c2816c37608d6ae11a3c04.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689200093198"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689200093198"}]},"ts":"1689200093198"} 2023-07-12 22:14:53,198 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed b4ca7a4a41d66f110e300fe516e45002 2023-07-12 22:14:53,199 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=b4ca7a4a41d66f110e300fe516e45002, regionState=CLOSED 2023-07-12 22:14:53,199 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689200060236.b4ca7a4a41d66f110e300fe516e45002.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689200093199"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689200093199"}]},"ts":"1689200093199"} 2023-07-12 22:14:53,207 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=54, resume processing ppid=53 2023-07-12 22:14:53,207 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=54, ppid=53, state=SUCCESS; CloseRegionProcedure c227067987c2816c37608d6ae11a3c04, server=jenkins-hbase4.apache.org,34497,1689200016186 in 180 msec 2023-07-12 22:14:53,209 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=c227067987c2816c37608d6ae11a3c04, UNASSIGN in 196 msec 2023-07-12 22:14:53,210 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=55, resume processing ppid=52 2023-07-12 22:14:53,210 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=55, ppid=52, state=SUCCESS; CloseRegionProcedure b4ca7a4a41d66f110e300fe516e45002, server=jenkins-hbase4.apache.org,37349,1689200016037 in 185 msec 2023-07-12 22:14:53,219 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=51 2023-07-12 22:14:53,219 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=b4ca7a4a41d66f110e300fe516e45002, UNASSIGN in 199 msec 2023-07-12 22:14:53,220 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689200093219"}]},"ts":"1689200093219"} 2023-07-12 22:14:53,221 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-07-12 22:14:53,226 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-07-12 22:14:53,228 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 225 msec 2023-07-12 22:14:53,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-12 22:14:53,309 INFO [Listener at jenkins-hbase4.apache.org/41531] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-07-12 22:14:53,310 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-07-12 22:14:53,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] procedure2.ProcedureExecutor(1029): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-12 22:14:53,314 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-12 22:14:53,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-07-12 22:14:53,315 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-12 22:14:53,318 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34497] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-07-12 22:14:53,321 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-12 22:14:53,321 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-12 22:14:53,321 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-12 22:14:53,321 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-12 22:14:53,322 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testConsecutiveExports/b4ca7a4a41d66f110e300fe516e45002 2023-07-12 22:14:53,322 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-12 22:14:53,322 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-12 22:14:53,322 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-12 22:14:53,322 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-12 22:14:53,322 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testConsecutiveExports/c227067987c2816c37608d6ae11a3c04 2023-07-12 22:14:53,323 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-12 22:14:53,323 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-12 22:14:53,323 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-12 22:14:53,323 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 22:14:53,323 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-12 22:14:53,323 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 22:14:53,323 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 22:14:53,323 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 22:14:53,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-12 22:14:53,325 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testConsecutiveExports/b4ca7a4a41d66f110e300fe516e45002/cf, FileablePath, hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testConsecutiveExports/b4ca7a4a41d66f110e300fe516e45002/recovered.edits] 2023-07-12 22:14:53,325 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testConsecutiveExports/c227067987c2816c37608d6ae11a3c04/cf, FileablePath, hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testConsecutiveExports/c227067987c2816c37608d6ae11a3c04/recovered.edits] 2023-07-12 22:14:53,329 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testConsecutiveExports/b4ca7a4a41d66f110e300fe516e45002/cf/92ef2de71d4e4b8695f91bc43de2131c to hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/archive/data/default/testtb-testConsecutiveExports/b4ca7a4a41d66f110e300fe516e45002/cf/92ef2de71d4e4b8695f91bc43de2131c 2023-07-12 22:14:53,330 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testConsecutiveExports/c227067987c2816c37608d6ae11a3c04/cf/cf472dfe85e54621b4639900022f94b0 to hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/archive/data/default/testtb-testConsecutiveExports/c227067987c2816c37608d6ae11a3c04/cf/cf472dfe85e54621b4639900022f94b0 2023-07-12 22:14:53,333 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testConsecutiveExports/b4ca7a4a41d66f110e300fe516e45002/recovered.edits/9.seqid to hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/archive/data/default/testtb-testConsecutiveExports/b4ca7a4a41d66f110e300fe516e45002/recovered.edits/9.seqid 2023-07-12 22:14:53,334 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testConsecutiveExports/c227067987c2816c37608d6ae11a3c04/recovered.edits/9.seqid to hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/archive/data/default/testtb-testConsecutiveExports/c227067987c2816c37608d6ae11a3c04/recovered.edits/9.seqid 2023-07-12 22:14:53,335 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testConsecutiveExports/c227067987c2816c37608d6ae11a3c04 2023-07-12 22:14:53,338 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testConsecutiveExports/b4ca7a4a41d66f110e300fe516e45002 2023-07-12 22:14:53,338 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-12 22:14:53,341 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-07-12 22:14:53,342 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf] 2023-07-12 22:14:53,346 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023071277d634abbed646dba035c7daad9a06cd to hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023071277d634abbed646dba035c7daad9a06cd 2023-07-12 22:14:53,350 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e2023071243e513ec515d4d6a86d42e0670d9c94b to hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e2023071243e513ec515d4d6a86d42e0670d9c94b 2023-07-12 22:14:53,351 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-07-12 22:14:53,353 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-12 22:14:53,356 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-07-12 22:14:53,358 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-07-12 22:14:53,359 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-12 22:14:53,359 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-07-12 22:14:53,360 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1689200060236.b4ca7a4a41d66f110e300fe516e45002.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689200093359"}]},"ts":"9223372036854775807"} 2023-07-12 22:14:53,360 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1689200060236.c227067987c2816c37608d6ae11a3c04.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689200093359"}]},"ts":"9223372036854775807"} 2023-07-12 22:14:53,381 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-12 22:14:53,381 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => b4ca7a4a41d66f110e300fe516e45002, NAME => 'testtb-testConsecutiveExports,,1689200060236.b4ca7a4a41d66f110e300fe516e45002.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => c227067987c2816c37608d6ae11a3c04, NAME => 'testtb-testConsecutiveExports,1,1689200060236.c227067987c2816c37608d6ae11a3c04.', STARTKEY => '1', ENDKEY => ''}] 2023-07-12 22:14:53,381 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-07-12 22:14:53,381 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689200093381"}]},"ts":"9223372036854775807"} 2023-07-12 22:14:53,385 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-07-12 22:14:53,388 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-12 22:14:53,393 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 78 msec 2023-07-12 22:14:53,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-12 22:14:53,428 INFO [Listener at jenkins-hbase4.apache.org/41531] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-07-12 22:14:53,440 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-07-12 22:14:53,444 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:53,447 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-07-12 22:14:53,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-07-12 22:14:53,483 INFO [Listener at jenkins-hbase4.apache.org/41531] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=743 (was 766), OpenFileDescriptor=895 (was 927), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=505 (was 430) - SystemLoadAverage LEAK? -, ProcessCount=179 (was 177) - ProcessCount LEAK? -, AvailableMemoryMB=5179 (was 4665) - AvailableMemoryMB LEAK? - 2023-07-12 22:14:53,483 WARN [Listener at jenkins-hbase4.apache.org/41531] hbase.ResourceChecker(130): Thread=743 is superior to 500 2023-07-12 22:14:53,505 INFO [Listener at jenkins-hbase4.apache.org/41531] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=743, OpenFileDescriptor=895, MaxFileDescriptor=60000, SystemLoadAverage=505, ProcessCount=179, AvailableMemoryMB=5176 2023-07-12 22:14:53,505 WARN [Listener at jenkins-hbase4.apache.org/41531] hbase.ResourceChecker(130): Thread=743 is superior to 500 2023-07-12 22:14:53,507 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-12 22:14:53,509 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] procedure2.ProcedureExecutor(1029): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:53,511 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 22:14:53,511 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-07-12 22:14:53,511 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 22:14:53,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-12 22:14:53,514 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/ba1a7b21bb35eb9cc9d0a5d281ec91ed 2023-07-12 22:14:53,514 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/15ba7a001fd5b7c3732c82989249f2d4 2023-07-12 22:14:53,515 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/ba1a7b21bb35eb9cc9d0a5d281ec91ed empty. 2023-07-12 22:14:53,515 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/15ba7a001fd5b7c3732c82989249f2d4 empty. 2023-07-12 22:14:53,515 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/ba1a7b21bb35eb9cc9d0a5d281ec91ed 2023-07-12 22:14:53,515 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/15ba7a001fd5b7c3732c82989249f2d4 2023-07-12 22:14:53,515 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-12 22:14:53,525 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-07-12 22:14:53,526 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => ba1a7b21bb35eb9cc9d0a5d281ec91ed, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689200093507.ba1a7b21bb35eb9cc9d0a5d281ec91ed.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp 2023-07-12 22:14:53,526 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => 15ba7a001fd5b7c3732c82989249f2d4, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689200093507.15ba7a001fd5b7c3732c82989249f2d4.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp 2023-07-12 22:14:53,549 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689200093507.ba1a7b21bb35eb9cc9d0a5d281ec91ed.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 22:14:53,549 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing ba1a7b21bb35eb9cc9d0a5d281ec91ed, disabling compactions & flushes 2023-07-12 22:14:53,549 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689200093507.ba1a7b21bb35eb9cc9d0a5d281ec91ed. 2023-07-12 22:14:53,549 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689200093507.ba1a7b21bb35eb9cc9d0a5d281ec91ed. 2023-07-12 22:14:53,549 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689200093507.ba1a7b21bb35eb9cc9d0a5d281ec91ed. after waiting 0 ms 2023-07-12 22:14:53,549 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689200093507.ba1a7b21bb35eb9cc9d0a5d281ec91ed. 2023-07-12 22:14:53,549 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689200093507.ba1a7b21bb35eb9cc9d0a5d281ec91ed. 2023-07-12 22:14:53,549 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for ba1a7b21bb35eb9cc9d0a5d281ec91ed: 2023-07-12 22:14:53,552 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689200093507.15ba7a001fd5b7c3732c82989249f2d4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 22:14:53,553 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing 15ba7a001fd5b7c3732c82989249f2d4, disabling compactions & flushes 2023-07-12 22:14:53,553 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689200093507.15ba7a001fd5b7c3732c82989249f2d4. 2023-07-12 22:14:53,553 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689200093507.15ba7a001fd5b7c3732c82989249f2d4. 2023-07-12 22:14:53,553 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689200093507.15ba7a001fd5b7c3732c82989249f2d4. after waiting 0 ms 2023-07-12 22:14:53,553 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689200093507.15ba7a001fd5b7c3732c82989249f2d4. 2023-07-12 22:14:53,553 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689200093507.15ba7a001fd5b7c3732c82989249f2d4. 2023-07-12 22:14:53,553 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for 15ba7a001fd5b7c3732c82989249f2d4: 2023-07-12 22:14:53,555 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 22:14:53,556 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689200093507.ba1a7b21bb35eb9cc9d0a5d281ec91ed.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689200093556"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689200093556"}]},"ts":"1689200093556"} 2023-07-12 22:14:53,557 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689200093507.15ba7a001fd5b7c3732c82989249f2d4.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689200093556"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689200093556"}]},"ts":"1689200093556"} 2023-07-12 22:14:53,565 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-12 22:14:53,567 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 22:14:53,567 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689200093567"}]},"ts":"1689200093567"} 2023-07-12 22:14:53,568 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-07-12 22:14:53,573 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-12 22:14:53,576 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 22:14:53,576 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 22:14:53,576 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-12 22:14:53,576 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 22:14:53,576 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=ba1a7b21bb35eb9cc9d0a5d281ec91ed, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=15ba7a001fd5b7c3732c82989249f2d4, ASSIGN}] 2023-07-12 22:14:53,580 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=15ba7a001fd5b7c3732c82989249f2d4, ASSIGN 2023-07-12 22:14:53,580 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=ba1a7b21bb35eb9cc9d0a5d281ec91ed, ASSIGN 2023-07-12 22:14:53,581 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=15ba7a001fd5b7c3732c82989249f2d4, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40411,1689200016125; forceNewPlan=false, retain=false 2023-07-12 22:14:53,582 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=ba1a7b21bb35eb9cc9d0a5d281ec91ed, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37349,1689200016037; forceNewPlan=false, retain=false 2023-07-12 22:14:53,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-12 22:14:53,734 INFO [jenkins-hbase4:43225] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-12 22:14:53,738 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=ba1a7b21bb35eb9cc9d0a5d281ec91ed, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:53,738 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=15ba7a001fd5b7c3732c82989249f2d4, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:14:53,738 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689200093507.15ba7a001fd5b7c3732c82989249f2d4.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689200093738"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689200093738"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689200093738"}]},"ts":"1689200093738"} 2023-07-12 22:14:53,738 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689200093507.ba1a7b21bb35eb9cc9d0a5d281ec91ed.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689200093738"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689200093738"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689200093738"}]},"ts":"1689200093738"} 2023-07-12 22:14:53,741 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE; OpenRegionProcedure 15ba7a001fd5b7c3732c82989249f2d4, server=jenkins-hbase4.apache.org,40411,1689200016125}] 2023-07-12 22:14:53,742 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=58, state=RUNNABLE; OpenRegionProcedure ba1a7b21bb35eb9cc9d0a5d281ec91ed, server=jenkins-hbase4.apache.org,37349,1689200016037}] 2023-07-12 22:14:53,815 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-12 22:14:53,904 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1689200093507.15ba7a001fd5b7c3732c82989249f2d4. 2023-07-12 22:14:53,904 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 15ba7a001fd5b7c3732c82989249f2d4, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689200093507.15ba7a001fd5b7c3732c82989249f2d4.', STARTKEY => '1', ENDKEY => ''} 2023-07-12 22:14:53,904 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1689200093507.15ba7a001fd5b7c3732c82989249f2d4. service=AccessControlService 2023-07-12 22:14:53,904 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 22:14:53,905 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 15ba7a001fd5b7c3732c82989249f2d4 2023-07-12 22:14:53,905 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689200093507.15ba7a001fd5b7c3732c82989249f2d4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 22:14:53,905 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 15ba7a001fd5b7c3732c82989249f2d4 2023-07-12 22:14:53,905 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 15ba7a001fd5b7c3732c82989249f2d4 2023-07-12 22:14:53,912 INFO [StoreOpener-15ba7a001fd5b7c3732c82989249f2d4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 15ba7a001fd5b7c3732c82989249f2d4 2023-07-12 22:14:53,912 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1689200093507.ba1a7b21bb35eb9cc9d0a5d281ec91ed. 2023-07-12 22:14:53,912 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ba1a7b21bb35eb9cc9d0a5d281ec91ed, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689200093507.ba1a7b21bb35eb9cc9d0a5d281ec91ed.', STARTKEY => '', ENDKEY => '1'} 2023-07-12 22:14:53,913 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1689200093507.ba1a7b21bb35eb9cc9d0a5d281ec91ed. service=AccessControlService 2023-07-12 22:14:53,913 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 22:14:53,913 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion ba1a7b21bb35eb9cc9d0a5d281ec91ed 2023-07-12 22:14:53,913 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689200093507.ba1a7b21bb35eb9cc9d0a5d281ec91ed.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 22:14:53,913 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ba1a7b21bb35eb9cc9d0a5d281ec91ed 2023-07-12 22:14:53,913 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ba1a7b21bb35eb9cc9d0a5d281ec91ed 2023-07-12 22:14:53,914 DEBUG [StoreOpener-15ba7a001fd5b7c3732c82989249f2d4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testExportFileSystemStateWithMergeRegion/15ba7a001fd5b7c3732c82989249f2d4/cf 2023-07-12 22:14:53,914 DEBUG [StoreOpener-15ba7a001fd5b7c3732c82989249f2d4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testExportFileSystemStateWithMergeRegion/15ba7a001fd5b7c3732c82989249f2d4/cf 2023-07-12 22:14:53,916 INFO [StoreOpener-15ba7a001fd5b7c3732c82989249f2d4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 15ba7a001fd5b7c3732c82989249f2d4 columnFamilyName cf 2023-07-12 22:14:53,919 INFO [StoreOpener-ba1a7b21bb35eb9cc9d0a5d281ec91ed-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region ba1a7b21bb35eb9cc9d0a5d281ec91ed 2023-07-12 22:14:53,920 INFO [StoreOpener-15ba7a001fd5b7c3732c82989249f2d4-1] regionserver.HStore(310): Store=15ba7a001fd5b7c3732c82989249f2d4/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 22:14:53,921 DEBUG [StoreOpener-ba1a7b21bb35eb9cc9d0a5d281ec91ed-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testExportFileSystemStateWithMergeRegion/ba1a7b21bb35eb9cc9d0a5d281ec91ed/cf 2023-07-12 22:14:53,922 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testExportFileSystemStateWithMergeRegion/15ba7a001fd5b7c3732c82989249f2d4 2023-07-12 22:14:53,922 DEBUG [StoreOpener-ba1a7b21bb35eb9cc9d0a5d281ec91ed-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testExportFileSystemStateWithMergeRegion/ba1a7b21bb35eb9cc9d0a5d281ec91ed/cf 2023-07-12 22:14:53,923 INFO [StoreOpener-ba1a7b21bb35eb9cc9d0a5d281ec91ed-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ba1a7b21bb35eb9cc9d0a5d281ec91ed columnFamilyName cf 2023-07-12 22:14:53,924 INFO [StoreOpener-ba1a7b21bb35eb9cc9d0a5d281ec91ed-1] regionserver.HStore(310): Store=ba1a7b21bb35eb9cc9d0a5d281ec91ed/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 22:14:53,927 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testExportFileSystemStateWithMergeRegion/15ba7a001fd5b7c3732c82989249f2d4 2023-07-12 22:14:53,931 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testExportFileSystemStateWithMergeRegion/ba1a7b21bb35eb9cc9d0a5d281ec91ed 2023-07-12 22:14:53,932 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testExportFileSystemStateWithMergeRegion/ba1a7b21bb35eb9cc9d0a5d281ec91ed 2023-07-12 22:14:53,936 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ba1a7b21bb35eb9cc9d0a5d281ec91ed 2023-07-12 22:14:53,938 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testExportFileSystemStateWithMergeRegion/ba1a7b21bb35eb9cc9d0a5d281ec91ed/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 22:14:53,938 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ba1a7b21bb35eb9cc9d0a5d281ec91ed; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60487957, jitterRate=-0.0986592024564743}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 22:14:53,939 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ba1a7b21bb35eb9cc9d0a5d281ec91ed: 2023-07-12 22:14:53,940 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1689200093507.ba1a7b21bb35eb9cc9d0a5d281ec91ed., pid=61, masterSystemTime=1689200093895 2023-07-12 22:14:53,940 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 15ba7a001fd5b7c3732c82989249f2d4 2023-07-12 22:14:53,942 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1689200093507.ba1a7b21bb35eb9cc9d0a5d281ec91ed. 2023-07-12 22:14:53,942 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1689200093507.ba1a7b21bb35eb9cc9d0a5d281ec91ed. 2023-07-12 22:14:53,943 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=ba1a7b21bb35eb9cc9d0a5d281ec91ed, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:53,943 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689200093507.ba1a7b21bb35eb9cc9d0a5d281ec91ed.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689200093942"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689200093942"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689200093942"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689200093942"}]},"ts":"1689200093942"} 2023-07-12 22:14:53,943 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testExportFileSystemStateWithMergeRegion/15ba7a001fd5b7c3732c82989249f2d4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 22:14:53,944 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 15ba7a001fd5b7c3732c82989249f2d4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72070891, jitterRate=0.0739399641752243}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 22:14:53,944 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 15ba7a001fd5b7c3732c82989249f2d4: 2023-07-12 22:14:53,945 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1689200093507.15ba7a001fd5b7c3732c82989249f2d4., pid=60, masterSystemTime=1689200093893 2023-07-12 22:14:53,947 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1689200093507.15ba7a001fd5b7c3732c82989249f2d4. 2023-07-12 22:14:53,947 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1689200093507.15ba7a001fd5b7c3732c82989249f2d4. 2023-07-12 22:14:53,948 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=15ba7a001fd5b7c3732c82989249f2d4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:14:53,948 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689200093507.15ba7a001fd5b7c3732c82989249f2d4.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689200093947"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689200093947"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689200093947"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689200093947"}]},"ts":"1689200093947"} 2023-07-12 22:14:53,948 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=58 2023-07-12 22:14:53,948 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=58, state=SUCCESS; OpenRegionProcedure ba1a7b21bb35eb9cc9d0a5d281ec91ed, server=jenkins-hbase4.apache.org,37349,1689200016037 in 204 msec 2023-07-12 22:14:53,950 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=ba1a7b21bb35eb9cc9d0a5d281ec91ed, ASSIGN in 372 msec 2023-07-12 22:14:53,952 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=59 2023-07-12 22:14:53,953 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=59, state=SUCCESS; OpenRegionProcedure 15ba7a001fd5b7c3732c82989249f2d4, server=jenkins-hbase4.apache.org,40411,1689200016125 in 209 msec 2023-07-12 22:14:53,955 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=59, resume processing ppid=57 2023-07-12 22:14:53,955 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=15ba7a001fd5b7c3732c82989249f2d4, ASSIGN in 376 msec 2023-07-12 22:14:53,959 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 22:14:53,959 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689200093959"}]},"ts":"1689200093959"} 2023-07-12 22:14:53,966 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-07-12 22:14:53,971 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 22:14:53,971 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-07-12 22:14:53,974 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34497] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-12 22:14:53,975 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 22:14:53,975 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 22:14:53,976 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 22:14:53,976 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 22:14:53,977 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:53,977 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:53,978 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 22:14:53,978 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 22:14:53,978 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 22:14:53,978 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 22:14:53,980 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 471 msec 2023-07-12 22:14:54,116 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-12 22:14:54,116 INFO [Listener at jenkins-hbase4.apache.org/41531] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-07-12 22:14:54,119 DEBUG [Listener at jenkins-hbase4.apache.org/41531] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,119 DEBUG [Listener at jenkins-hbase4.apache.org/41531] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1689200093507.ba1a7b21bb35eb9cc9d0a5d281ec91ed. 2023-07-12 22:14:54,121 INFO [Listener at jenkins-hbase4.apache.org/41531] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 22:14:54,147 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-12 22:14:54,148 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689200094148 (current time:1689200094148). 2023-07-12 22:14:54,148 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 22:14:54,148 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] zookeeper.ReadOnlyZKClient(139): Connect 0x4347691f to 127.0.0.1:62393 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 22:14:54,157 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2788fcd8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 22:14:54,158 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 22:14:54,163 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50536, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 22:14:54,164 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4347691f to 127.0.0.1:62393 2023-07-12 22:14:54,164 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 22:14:54,164 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] zookeeper.ReadOnlyZKClient(139): Connect 0x5ee821a3 to 127.0.0.1:62393 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 22:14:54,171 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@269fb4f0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 22:14:54,173 DEBUG [hconnection-0x4611e2c7-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 22:14:54,174 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50550, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 22:14:54,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 22:14:54,186 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42866, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 22:14:54,199 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5ee821a3 to 127.0.0.1:62393 2023-07-12 22:14:54,199 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 22:14:54,199 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-12 22:14:54,203 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 22:14:54,203 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-12 22:14:54,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] procedure2.ProcedureExecutor(1029): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-12 22:14:54,211 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-12 22:14:54,212 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689200694212 2023-07-12 22:14:54,212 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-12 22:14:54,212 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,212 DEBUG [Listener at jenkins-hbase4.apache.org/41531] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 22:14:54,212 DEBUG [Listener at jenkins-hbase4.apache.org/41531] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 22:14:54,215 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-12 22:14:54,215 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-12 22:14:54,218 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 7 msec 2023-07-12 22:14:54,219 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-12 22:14:54,220 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689200694220 2023-07-12 22:14:54,235 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,235 INFO [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-12 22:14:54,235 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 22:14:54,236 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-12 22:14:54,237 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-12 22:14:54,311 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,311 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,313 DEBUG [Listener at jenkins-hbase4.apache.org/41531] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 22:14:54,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-12 22:14:54,315 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-12 22:14:54,315 DEBUG [Listener at jenkins-hbase4.apache.org/41531] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 22:14:54,319 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:14:54,319 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:14:54,319 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:14:54,319 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:14:54,319 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:14:54,319 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:14:54,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:14:54,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:14:54,320 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:14:54,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:14:54,320 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:14:54,320 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:54,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,320 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:54,321 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 22:14:54,321 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,321 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-12 22:14:54,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-12 22:14:54,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,323 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-12 22:14:54,323 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-12 22:14:54,324 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-12 22:14:54,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,324 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-12 22:14:54,330 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,331 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-12 22:14:54,331 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 22:14:54,338 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-12 22:14:54,339 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-12 22:14:54,339 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34497,1689200016186' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-12 22:14:54,339 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,339 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,339 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-12 22:14:54,339 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 22:14:54,339 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-12 22:14:54,340 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-12 22:14:54,340 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-12 22:14:54,341 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40411,1689200016125' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-12 22:14:54,340 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 22:14:54,342 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-12 22:14:54,342 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-12 22:14:54,342 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37349,1689200016037' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-12 22:14:54,344 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,345 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,345 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,345 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 22:14:54,345 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,345 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,345 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 22:14:54,346 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,346 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 22:14:54,346 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:14:54,346 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:54,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:14:54,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 22:14:54,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 22:14:54,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 22:14:54,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 22:14:54,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:14:54,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:14:54,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:54,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 22:14:54,349 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40411,1689200016125' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-12 22:14:54,349 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3ed49078[Count = 1] remaining members to acquire global barrier 2023-07-12 22:14:54,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:54,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 22:14:54,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 22:14:54,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 22:14:54,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 22:14:54,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:14:54,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:14:54,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:54,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 22:14:54,355 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37349,1689200016037' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-12 22:14:54,355 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3ed49078[Count = 0] remaining members to acquire global barrier 2023-07-12 22:14:54,355 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-12 22:14:54,355 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,357 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,357 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,357 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,357 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,357 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,357 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,357 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-12 22:14:54,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,357 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-12 22:14:54,357 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-12 22:14:54,357 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,34497,1689200016186' in zk 2023-07-12 22:14:54,357 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-12 22:14:54,358 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 22:14:54,358 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 22:14:54,358 DEBUG [rs(jenkins-hbase4.apache.org,37349,1689200016037)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689200093507.ba1a7b21bb35eb9cc9d0a5d281ec91ed. 2023-07-12 22:14:54,358 DEBUG [rs(jenkins-hbase4.apache.org,37349,1689200016037)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689200093507.ba1a7b21bb35eb9cc9d0a5d281ec91ed. started... 2023-07-12 22:14:54,358 DEBUG [rs(jenkins-hbase4.apache.org,37349,1689200016037)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ba1a7b21bb35eb9cc9d0a5d281ec91ed: 2023-07-12 22:14:54,358 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 22:14:54,358 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 22:14:54,359 DEBUG [rs(jenkins-hbase4.apache.org,37349,1689200016037)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689200093507.ba1a7b21bb35eb9cc9d0a5d281ec91ed.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,359 DEBUG [rs(jenkins-hbase4.apache.org,37349,1689200016037)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 22:14:54,359 DEBUG [rs(jenkins-hbase4.apache.org,40411,1689200016125)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689200093507.15ba7a001fd5b7c3732c82989249f2d4. 2023-07-12 22:14:54,359 DEBUG [rs(jenkins-hbase4.apache.org,37349,1689200016037)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 22:14:54,359 DEBUG [rs(jenkins-hbase4.apache.org,40411,1689200016125)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689200093507.15ba7a001fd5b7c3732c82989249f2d4. started... 2023-07-12 22:14:54,361 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:14:54,361 DEBUG [rs(jenkins-hbase4.apache.org,40411,1689200016125)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 15ba7a001fd5b7c3732c82989249f2d4: 2023-07-12 22:14:54,361 DEBUG [rs(jenkins-hbase4.apache.org,40411,1689200016125)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689200093507.15ba7a001fd5b7c3732c82989249f2d4.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,362 DEBUG [rs(jenkins-hbase4.apache.org,40411,1689200016125)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 22:14:54,362 DEBUG [rs(jenkins-hbase4.apache.org,40411,1689200016125)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 22:14:54,362 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:54,362 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 22:14:54,367 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-12 22:14:54,367 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 22:14:54,368 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-12 22:14:54,427 DEBUG [rs(jenkins-hbase4.apache.org,37349,1689200016037)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689200093507.ba1a7b21bb35eb9cc9d0a5d281ec91ed. completed. 2023-07-12 22:14:54,427 DEBUG [rs(jenkins-hbase4.apache.org,37349,1689200016037)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689200093507.ba1a7b21bb35eb9cc9d0a5d281ec91ed. 2023-07-12 22:14:54,427 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 22:14:54,427 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 22:14:54,427 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:54,427 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-12 22:14:54,427 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,37349,1689200016037' in zk 2023-07-12 22:14:54,429 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:54,429 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-12 22:14:54,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:54,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 22:14:54,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 22:14:54,429 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 22:14:54,430 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-12 22:14:54,430 DEBUG [rs(jenkins-hbase4.apache.org,40411,1689200016125)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689200093507.15ba7a001fd5b7c3732c82989249f2d4. completed. 2023-07-12 22:14:54,430 DEBUG [rs(jenkins-hbase4.apache.org,40411,1689200016125)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689200093507.15ba7a001fd5b7c3732c82989249f2d4. 2023-07-12 22:14:54,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 22:14:54,432 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 22:14:54,432 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 22:14:54,432 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:14:54,432 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-12 22:14:54,433 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,40411,1689200016125' in zk 2023-07-12 22:14:54,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 22:14:54,442 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-12 22:14:54,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,442 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 22:14:54,443 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-12 22:14:54,442 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:14:54,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:14:54,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:14:54,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:54,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 22:14:54,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:14:54,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:14:54,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:54,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,37349,1689200016037': 2023-07-12 22:14:54,448 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37349,1689200016037' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-12 22:14:54,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:14:54,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 22:14:54,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 22:14:54,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 22:14:54,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 22:14:54,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:14:54,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:14:54,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:54,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 22:14:54,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:14:54,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:14:54,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:54,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,40411,1689200016125': 2023-07-12 22:14:54,462 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40411,1689200016125' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-12 22:14:54,463 INFO [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-12 22:14:54,463 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 22:14:54,463 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 22:14:54,463 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,463 INFO [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 22:14:54,466 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,466 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,466 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,466 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:14:54,466 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,466 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,467 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,467 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:14:54,467 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,467 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:14:54,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,467 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:14:54,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 22:14:54,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 22:14:54,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:14:54,467 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:14:54,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:14:54,467 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:14:54,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:14:54,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 22:14:54,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 22:14:54,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:14:54,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:14:54,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:54,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 22:14:54,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,471 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:14:54,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:14:54,471 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:14:54,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:14:54,472 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:54,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:54,474 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:14:54,475 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:14:54,475 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:54,480 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:14:54,480 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:14:54,480 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:14:54,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:14:54,480 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:14:54,481 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:14:54,481 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:14:54,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:14:54,481 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:14:54,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:14:54,482 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:14:54,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:14:54,482 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:14:54,482 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:14:54,482 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:14:54,482 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:54,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:14:54,482 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 22:14:54,482 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,483 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:14:54,485 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:14:54,482 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,485 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:14:54,485 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:14:54,485 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,485 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,485 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-12 22:14:54,485 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:54,485 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,485 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:14:54,485 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:14:54,485 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,486 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,486 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-12 22:14:54,515 DEBUG [Listener at jenkins-hbase4.apache.org/41531] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 22:14:54,517 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-12 22:14:54,517 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-12 22:14:54,517 DEBUG [Listener at jenkins-hbase4.apache.org/41531] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-12 22:14:54,527 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,527 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,601 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,678 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-12 22:14:54,678 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,679 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,679 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689200094212Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1689200094527 (+315 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689200094527Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689200094527Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689200094558 (+31 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689200094583 (+25 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689200094678 (+95 ms) 2023-07-12 22:14:54,683 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-12 22:14:54,684 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 469 msec 2023-07-12 22:14:54,817 DEBUG [Listener at jenkins-hbase4.apache.org/41531] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 22:14:54,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-12 22:14:54,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 22:14:54,822 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37349] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1689200093507.ba1a7b21bb35eb9cc9d0a5d281ec91ed. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 22:14:54,824 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40411] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1689200093507.15ba7a001fd5b7c3732c82989249f2d4. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 22:14:54,827 DEBUG [Listener at jenkins-hbase4.apache.org/41531] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,827 DEBUG [Listener at jenkins-hbase4.apache.org/41531] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1689200093507.ba1a7b21bb35eb9cc9d0a5d281ec91ed. 2023-07-12 22:14:54,828 INFO [Listener at jenkins-hbase4.apache.org/41531] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 22:14:54,848 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-12 22:14:54,848 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689200094848 (current time:1689200094848). 2023-07-12 22:14:54,848 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 22:14:54,849 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] zookeeper.ReadOnlyZKClient(139): Connect 0x2caf3113 to 127.0.0.1:62393 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 22:14:54,864 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4cafff3e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 22:14:54,866 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 22:14:54,871 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50552, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 22:14:54,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2caf3113 to 127.0.0.1:62393 2023-07-12 22:14:54,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 22:14:54,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] zookeeper.ReadOnlyZKClient(139): Connect 0x0f57ea2f to 127.0.0.1:62393 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 22:14:54,884 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5a25757f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 22:14:54,980 DEBUG [hconnection-0x6940370a-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 22:14:54,985 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50564, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 22:14:54,994 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 22:14:54,996 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42880, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 22:14:54,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0f57ea2f to 127.0.0.1:62393 2023-07-12 22:14:54,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 22:14:54,999 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-12 22:14:55,000 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 22:14:55,000 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-12 22:14:55,003 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-12 22:14:55,005 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-12 22:14:55,007 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689200695006 2023-07-12 22:14:55,007 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:55,007 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-12 22:14:55,010 DEBUG [Listener at jenkins-hbase4.apache.org/41531] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 22:14:55,010 DEBUG [Listener at jenkins-hbase4.apache.org/41531] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 22:14:55,012 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-12 22:14:55,012 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-12 22:14:55,014 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 10 msec 2023-07-12 22:14:55,015 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-12 22:14:55,016 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689200695016 2023-07-12 22:14:55,066 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:55,067 INFO [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-12 22:14:55,067 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 22:14:55,077 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-12 22:14:55,077 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-12 22:14:55,103 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:55,103 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:55,105 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:14:55,105 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:14:55,105 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:14:55,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:14:55,105 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:14:55,105 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:14:55,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:14:55,105 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:14:55,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:55,106 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:14:55,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:14:55,106 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:55,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:55,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:55,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-12 22:14:55,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:55,107 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-12 22:14:55,107 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:55,107 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:55,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-12 22:14:55,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:55,108 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-12 22:14:55,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-12 22:14:55,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:55,108 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-12 22:14:55,110 DEBUG [Listener at jenkins-hbase4.apache.org/41531] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 22:14:55,110 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:55,110 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:14:55,110 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:55,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-12 22:14:55,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-12 22:14:55,110 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-12 22:14:55,111 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 22:14:55,112 DEBUG [Listener at jenkins-hbase4.apache.org/41531] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 22:14:55,112 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:55,112 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 22:14:55,124 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:55,124 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-12 22:14:55,135 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:55,126 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-12 22:14:55,135 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-12 22:14:55,135 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 22:14:55,135 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 22:14:55,137 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-12 22:14:55,139 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-12 22:14:55,135 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-12 22:14:55,139 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40411,1689200016125' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-12 22:14:55,138 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-12 22:14:55,139 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-12 22:14:55,139 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37349,1689200016037' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-12 22:14:55,139 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34497,1689200016186' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-12 22:14:55,142 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:55,142 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:55,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:55,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 22:14:55,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 22:14:55,142 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:55,143 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:55,143 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 22:14:55,143 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:55,143 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 22:14:55,143 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:55,144 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:14:55,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 22:14:55,144 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:55,144 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 22:14:55,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 22:14:55,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:55,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:14:55,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:14:55,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:55,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 22:14:55,146 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37349,1689200016037' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-12 22:14:55,146 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@79f7b5e[Count = 1] remaining members to acquire global barrier 2023-07-12 22:14:55,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:14:55,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 22:14:55,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 22:14:55,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 22:14:55,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 22:14:55,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:55,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:14:55,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:14:55,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:55,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 22:14:55,150 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40411,1689200016125' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-12 22:14:55,150 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@79f7b5e[Count = 0] remaining members to acquire global barrier 2023-07-12 22:14:55,150 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-12 22:14:55,150 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:55,151 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:55,151 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:55,151 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:55,152 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:55,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:55,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:55,152 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-12 22:14:55,152 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-12 22:14:55,152 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-12 22:14:55,152 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,34497,1689200016186' in zk 2023-07-12 22:14:55,152 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:55,152 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:55,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:55,153 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-12 22:14:55,154 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-12 22:14:55,154 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 22:14:55,154 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-12 22:14:55,157 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:55,157 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:14:55,157 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 22:14:55,178 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 22:14:55,179 DEBUG [rs(jenkins-hbase4.apache.org,37349,1689200016037)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689200093507.ba1a7b21bb35eb9cc9d0a5d281ec91ed. 2023-07-12 22:14:55,179 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 22:14:55,178 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 22:14:55,179 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 22:14:55,179 DEBUG [rs(jenkins-hbase4.apache.org,40411,1689200016125)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689200093507.15ba7a001fd5b7c3732c82989249f2d4. 2023-07-12 22:14:55,179 DEBUG [rs(jenkins-hbase4.apache.org,37349,1689200016037)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689200093507.ba1a7b21bb35eb9cc9d0a5d281ec91ed. started... 2023-07-12 22:14:55,179 DEBUG [rs(jenkins-hbase4.apache.org,40411,1689200016125)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689200093507.15ba7a001fd5b7c3732c82989249f2d4. started... 2023-07-12 22:14:55,179 INFO [rs(jenkins-hbase4.apache.org,37349,1689200016037)-snapshot-pool-0] regionserver.HRegion(2745): Flushing ba1a7b21bb35eb9cc9d0a5d281ec91ed 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-12 22:14:55,179 INFO [rs(jenkins-hbase4.apache.org,40411,1689200016125)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 15ba7a001fd5b7c3732c82989249f2d4 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-12 22:14:55,239 INFO [rs(jenkins-hbase4.apache.org,37349,1689200016037)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023071267d4e4521d464d45837586d8fbf2abb4 to hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e2023071267d4e4521d464d45837586d8fbf2abb4 2023-07-12 22:14:55,268 INFO [rs(jenkins-hbase4.apache.org,40411,1689200016125)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230712ae59ef169ffa4f0c856938424fdf14c8 to hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230712ae59ef169ffa4f0c856938424fdf14c8 2023-07-12 22:14:55,283 INFO [rs(jenkins-hbase4.apache.org,37349,1689200016037)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testExportFileSystemStateWithMergeRegion/ba1a7b21bb35eb9cc9d0a5d281ec91ed/.tmp/cf/59d4bfc39f964194a41ab5b7d8f1ea3a 2023-07-12 22:14:55,293 INFO [rs(jenkins-hbase4.apache.org,40411,1689200016125)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testExportFileSystemStateWithMergeRegion/15ba7a001fd5b7c3732c82989249f2d4/.tmp/cf/c71366b7bf45494f8dcc4bbb89f3db74 2023-07-12 22:14:55,293 DEBUG [rs(jenkins-hbase4.apache.org,37349,1689200016037)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testExportFileSystemStateWithMergeRegion/ba1a7b21bb35eb9cc9d0a5d281ec91ed/.tmp/cf/59d4bfc39f964194a41ab5b7d8f1ea3a as hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testExportFileSystemStateWithMergeRegion/ba1a7b21bb35eb9cc9d0a5d281ec91ed/cf/59d4bfc39f964194a41ab5b7d8f1ea3a 2023-07-12 22:14:55,303 INFO [rs(jenkins-hbase4.apache.org,37349,1689200016037)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testExportFileSystemStateWithMergeRegion/ba1a7b21bb35eb9cc9d0a5d281ec91ed/cf/59d4bfc39f964194a41ab5b7d8f1ea3a, entries=4, sequenceid=6, filesize=5.6 K 2023-07-12 22:14:55,304 INFO [rs(jenkins-hbase4.apache.org,37349,1689200016037)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for ba1a7b21bb35eb9cc9d0a5d281ec91ed in 125ms, sequenceid=6, compaction requested=false 2023-07-12 22:14:55,304 DEBUG [rs(jenkins-hbase4.apache.org,37349,1689200016037)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-07-12 22:14:55,305 DEBUG [rs(jenkins-hbase4.apache.org,37349,1689200016037)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ba1a7b21bb35eb9cc9d0a5d281ec91ed: 2023-07-12 22:14:55,305 DEBUG [rs(jenkins-hbase4.apache.org,37349,1689200016037)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689200093507.ba1a7b21bb35eb9cc9d0a5d281ec91ed.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:55,305 DEBUG [rs(jenkins-hbase4.apache.org,37349,1689200016037)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 22:14:55,305 DEBUG [rs(jenkins-hbase4.apache.org,37349,1689200016037)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testExportFileSystemStateWithMergeRegion/ba1a7b21bb35eb9cc9d0a5d281ec91ed/cf/59d4bfc39f964194a41ab5b7d8f1ea3a] hfiles 2023-07-12 22:14:55,305 DEBUG [rs(jenkins-hbase4.apache.org,37349,1689200016037)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testExportFileSystemStateWithMergeRegion/ba1a7b21bb35eb9cc9d0a5d281ec91ed/cf/59d4bfc39f964194a41ab5b7d8f1ea3a for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:55,312 DEBUG [Listener at jenkins-hbase4.apache.org/41531] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 22:14:55,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-12 22:14:55,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-12 22:14:55,313 DEBUG [Listener at jenkins-hbase4.apache.org/41531] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-12 22:14:55,317 DEBUG [rs(jenkins-hbase4.apache.org,40411,1689200016125)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testExportFileSystemStateWithMergeRegion/15ba7a001fd5b7c3732c82989249f2d4/.tmp/cf/c71366b7bf45494f8dcc4bbb89f3db74 as hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testExportFileSystemStateWithMergeRegion/15ba7a001fd5b7c3732c82989249f2d4/cf/c71366b7bf45494f8dcc4bbb89f3db74 2023-07-12 22:14:55,325 INFO [rs(jenkins-hbase4.apache.org,40411,1689200016125)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testExportFileSystemStateWithMergeRegion/15ba7a001fd5b7c3732c82989249f2d4/cf/c71366b7bf45494f8dcc4bbb89f3db74, entries=46, sequenceid=6, filesize=13.4 K 2023-07-12 22:14:55,326 INFO [rs(jenkins-hbase4.apache.org,40411,1689200016125)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 15ba7a001fd5b7c3732c82989249f2d4 in 147ms, sequenceid=6, compaction requested=false 2023-07-12 22:14:55,328 DEBUG [rs(jenkins-hbase4.apache.org,40411,1689200016125)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 15ba7a001fd5b7c3732c82989249f2d4: 2023-07-12 22:14:55,328 DEBUG [rs(jenkins-hbase4.apache.org,40411,1689200016125)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689200093507.15ba7a001fd5b7c3732c82989249f2d4.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:55,328 DEBUG [rs(jenkins-hbase4.apache.org,40411,1689200016125)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 22:14:55,328 DEBUG [rs(jenkins-hbase4.apache.org,40411,1689200016125)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testExportFileSystemStateWithMergeRegion/15ba7a001fd5b7c3732c82989249f2d4/cf/c71366b7bf45494f8dcc4bbb89f3db74] hfiles 2023-07-12 22:14:55,328 DEBUG [rs(jenkins-hbase4.apache.org,40411,1689200016125)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testExportFileSystemStateWithMergeRegion/15ba7a001fd5b7c3732c82989249f2d4/cf/c71366b7bf45494f8dcc4bbb89f3db74 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:55,335 DEBUG [rs(jenkins-hbase4.apache.org,37349,1689200016037)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689200093507.ba1a7b21bb35eb9cc9d0a5d281ec91ed. completed. 2023-07-12 22:14:55,335 DEBUG [rs(jenkins-hbase4.apache.org,37349,1689200016037)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689200093507.ba1a7b21bb35eb9cc9d0a5d281ec91ed. 2023-07-12 22:14:55,335 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 22:14:55,335 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 22:14:55,335 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:55,335 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-12 22:14:55,335 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,37349,1689200016037' in zk 2023-07-12 22:14:55,337 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:55,337 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-12 22:14:55,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:55,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 22:14:55,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 22:14:55,337 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 22:14:55,337 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-12 22:14:55,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 22:14:55,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 22:14:55,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:55,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:14:55,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:14:55,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:55,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 22:14:55,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:55,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:14:55,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:55,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,37349,1689200016037': 2023-07-12 22:14:55,343 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37349,1689200016037' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-12 22:14:55,361 DEBUG [rs(jenkins-hbase4.apache.org,40411,1689200016125)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689200093507.15ba7a001fd5b7c3732c82989249f2d4. completed. 2023-07-12 22:14:55,361 DEBUG [rs(jenkins-hbase4.apache.org,40411,1689200016125)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689200093507.15ba7a001fd5b7c3732c82989249f2d4. 2023-07-12 22:14:55,362 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 22:14:55,362 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 22:14:55,362 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:14:55,362 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-12 22:14:55,362 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,40411,1689200016125' in zk 2023-07-12 22:14:55,363 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-12 22:14:55,364 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:14:55,364 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 22:14:55,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:14:55,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 22:14:55,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 22:14:55,364 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-12 22:14:55,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 22:14:55,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 22:14:55,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:55,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:14:55,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:14:55,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:55,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 22:14:55,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:55,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:14:55,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:14:55,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:55,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,40411,1689200016125': 2023-07-12 22:14:55,369 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40411,1689200016125' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-12 22:14:55,369 INFO [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-12 22:14:55,369 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 22:14:55,369 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 22:14:55,369 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:55,369 INFO [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 22:14:55,379 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:55,379 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:55,379 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:55,379 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:55,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:55,379 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:14:55,379 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:14:55,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:55,380 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:14:55,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:14:55,380 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:14:55,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:14:55,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:55,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:55,385 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:55,385 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:55,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:55,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 22:14:55,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 22:14:55,385 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:55,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:55,385 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:14:55,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 22:14:55,386 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:14:55,386 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:14:55,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:14:55,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:55,386 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:14:55,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:55,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 22:14:55,387 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:55,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:55,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:14:55,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:14:55,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:55,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 22:14:55,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:55,389 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:14:55,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:14:55,389 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:14:55,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:14:55,393 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:55,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:55,402 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:14:55,402 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:14:55,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:14:55,402 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:55,403 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:55,403 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:14:55,403 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:14:55,403 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:55,403 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:14:55,403 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:14:55,403 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:14:55,403 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:14:55,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:14:55,403 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:55,403 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:14:55,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:14:55,403 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:55,404 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:55,403 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 22:14:55,404 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:14:55,406 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:14:55,404 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:55,403 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:55,406 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-12 22:14:55,406 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:14:55,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:14:55,404 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:14:55,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:14:55,406 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:14:55,406 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:14:55,406 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:55,406 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:55,407 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:14:55,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:14:55,407 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230712ae59ef169ffa4f0c856938424fdf14c8, hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e2023071267d4e4521d464d45837586d8fbf2abb4] mob files 2023-07-12 22:14:55,407 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230712ae59ef169ffa4f0c856938424fdf14c8 2023-07-12 22:14:55,407 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e2023071267d4e4521d464d45837586d8fbf2abb4 2023-07-12 22:14:55,438 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:55,439 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:55,473 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:55,505 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-12 22:14:55,505 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:55,505 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:55,505 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689200095007Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1689200095438 (+431 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689200095438Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1689200095438Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1689200095447 (+9 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689200095464 (+17 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689200095505 (+41 ms) 2023-07-12 22:14:55,509 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-12 22:14:55,510 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 500 msec 2023-07-12 22:14:55,614 DEBUG [Listener at jenkins-hbase4.apache.org/41531] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 22:14:55,615 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-12 22:14:55,615 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 22:14:55,647 DEBUG [Listener at jenkins-hbase4.apache.org/41531] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-12 22:14:55,653 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42892, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-12 22:14:55,655 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34497] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-12 22:14:55,656 DEBUG [Listener at jenkins-hbase4.apache.org/41531] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-12 22:14:55,660 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34016, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-12 22:14:55,661 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37349] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-12 22:14:55,661 DEBUG [Listener at jenkins-hbase4.apache.org/41531] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-12 22:14:55,663 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50570, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-12 22:14:55,663 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40411] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-12 22:14:55,665 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-12 22:14:55,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] procedure2.ProcedureExecutor(1029): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:55,668 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 22:14:55,668 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-07-12 22:14:55,669 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 22:14:55,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-12 22:14:55,671 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/aa2d3a2b5adc2cf5b551827dc8bfd09c 2023-07-12 22:14:55,671 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/264b2f67c61eb0b9dcf6db2af575fe4b 2023-07-12 22:14:55,672 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/aa2d3a2b5adc2cf5b551827dc8bfd09c empty. 2023-07-12 22:14:55,672 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/264b2f67c61eb0b9dcf6db2af575fe4b empty. 2023-07-12 22:14:55,672 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/aa2d3a2b5adc2cf5b551827dc8bfd09c 2023-07-12 22:14:55,672 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/264b2f67c61eb0b9dcf6db2af575fe4b 2023-07-12 22:14:55,672 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-12 22:14:55,682 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-07-12 22:14:55,684 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => aa2d3a2b5adc2cf5b551827dc8bfd09c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689200095665.aa2d3a2b5adc2cf5b551827dc8bfd09c.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp 2023-07-12 22:14:55,684 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => 264b2f67c61eb0b9dcf6db2af575fe4b, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689200095665.264b2f67c61eb0b9dcf6db2af575fe4b.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp 2023-07-12 22:14:55,694 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689200095665.aa2d3a2b5adc2cf5b551827dc8bfd09c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 22:14:55,694 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing aa2d3a2b5adc2cf5b551827dc8bfd09c, disabling compactions & flushes 2023-07-12 22:14:55,694 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689200095665.aa2d3a2b5adc2cf5b551827dc8bfd09c. 2023-07-12 22:14:55,694 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689200095665.aa2d3a2b5adc2cf5b551827dc8bfd09c. 2023-07-12 22:14:55,694 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689200095665.aa2d3a2b5adc2cf5b551827dc8bfd09c. after waiting 0 ms 2023-07-12 22:14:55,694 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689200095665.aa2d3a2b5adc2cf5b551827dc8bfd09c. 2023-07-12 22:14:55,694 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689200095665.aa2d3a2b5adc2cf5b551827dc8bfd09c. 2023-07-12 22:14:55,694 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for aa2d3a2b5adc2cf5b551827dc8bfd09c: 2023-07-12 22:14:55,696 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689200095665.264b2f67c61eb0b9dcf6db2af575fe4b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 22:14:55,696 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing 264b2f67c61eb0b9dcf6db2af575fe4b, disabling compactions & flushes 2023-07-12 22:14:55,696 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689200095665.264b2f67c61eb0b9dcf6db2af575fe4b. 2023-07-12 22:14:55,696 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689200095665.264b2f67c61eb0b9dcf6db2af575fe4b. 2023-07-12 22:14:55,696 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689200095665.264b2f67c61eb0b9dcf6db2af575fe4b. after waiting 0 ms 2023-07-12 22:14:55,696 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689200095665.264b2f67c61eb0b9dcf6db2af575fe4b. 2023-07-12 22:14:55,696 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689200095665.264b2f67c61eb0b9dcf6db2af575fe4b. 2023-07-12 22:14:55,696 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for 264b2f67c61eb0b9dcf6db2af575fe4b: 2023-07-12 22:14:55,698 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 22:14:55,699 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689200095665.aa2d3a2b5adc2cf5b551827dc8bfd09c.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689200095699"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689200095699"}]},"ts":"1689200095699"} 2023-07-12 22:14:55,699 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689200095665.264b2f67c61eb0b9dcf6db2af575fe4b.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689200095699"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689200095699"}]},"ts":"1689200095699"} 2023-07-12 22:14:55,701 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-12 22:14:55,702 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 22:14:55,702 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689200095702"}]},"ts":"1689200095702"} 2023-07-12 22:14:55,703 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-07-12 22:14:55,764 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-12 22:14:55,766 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 22:14:55,766 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 22:14:55,766 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-12 22:14:55,766 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 22:14:55,766 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=aa2d3a2b5adc2cf5b551827dc8bfd09c, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=264b2f67c61eb0b9dcf6db2af575fe4b, ASSIGN}] 2023-07-12 22:14:55,769 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=aa2d3a2b5adc2cf5b551827dc8bfd09c, ASSIGN 2023-07-12 22:14:55,769 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=264b2f67c61eb0b9dcf6db2af575fe4b, ASSIGN 2023-07-12 22:14:55,770 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=264b2f67c61eb0b9dcf6db2af575fe4b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37349,1689200016037; forceNewPlan=false, retain=false 2023-07-12 22:14:55,770 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=aa2d3a2b5adc2cf5b551827dc8bfd09c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34497,1689200016186; forceNewPlan=false, retain=false 2023-07-12 22:14:55,770 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-12 22:14:55,920 INFO [jenkins-hbase4:43225] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-12 22:14:55,923 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=264b2f67c61eb0b9dcf6db2af575fe4b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:55,923 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=aa2d3a2b5adc2cf5b551827dc8bfd09c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:14:55,923 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689200095665.264b2f67c61eb0b9dcf6db2af575fe4b.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689200095923"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689200095923"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689200095923"}]},"ts":"1689200095923"} 2023-07-12 22:14:55,923 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689200095665.aa2d3a2b5adc2cf5b551827dc8bfd09c.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689200095923"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689200095923"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689200095923"}]},"ts":"1689200095923"} 2023-07-12 22:14:55,924 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=68, state=RUNNABLE; OpenRegionProcedure 264b2f67c61eb0b9dcf6db2af575fe4b, server=jenkins-hbase4.apache.org,37349,1689200016037}] 2023-07-12 22:14:55,925 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=70, ppid=67, state=RUNNABLE; OpenRegionProcedure aa2d3a2b5adc2cf5b551827dc8bfd09c, server=jenkins-hbase4.apache.org,34497,1689200016186}] 2023-07-12 22:14:55,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-12 22:14:56,118 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1689200095665.264b2f67c61eb0b9dcf6db2af575fe4b. 2023-07-12 22:14:56,119 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 264b2f67c61eb0b9dcf6db2af575fe4b, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689200095665.264b2f67c61eb0b9dcf6db2af575fe4b.', STARTKEY => '2', ENDKEY => ''} 2023-07-12 22:14:56,119 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689200095665.aa2d3a2b5adc2cf5b551827dc8bfd09c. 2023-07-12 22:14:56,119 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1689200095665.264b2f67c61eb0b9dcf6db2af575fe4b. service=AccessControlService 2023-07-12 22:14:56,119 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => aa2d3a2b5adc2cf5b551827dc8bfd09c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689200095665.aa2d3a2b5adc2cf5b551827dc8bfd09c.', STARTKEY => '', ENDKEY => '2'} 2023-07-12 22:14:56,120 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 22:14:56,120 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689200095665.aa2d3a2b5adc2cf5b551827dc8bfd09c. service=AccessControlService 2023-07-12 22:14:56,120 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 264b2f67c61eb0b9dcf6db2af575fe4b 2023-07-12 22:14:56,120 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689200095665.264b2f67c61eb0b9dcf6db2af575fe4b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 22:14:56,120 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 22:14:56,120 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 264b2f67c61eb0b9dcf6db2af575fe4b 2023-07-12 22:14:56,120 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 264b2f67c61eb0b9dcf6db2af575fe4b 2023-07-12 22:14:56,120 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 aa2d3a2b5adc2cf5b551827dc8bfd09c 2023-07-12 22:14:56,120 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689200095665.aa2d3a2b5adc2cf5b551827dc8bfd09c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 22:14:56,120 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for aa2d3a2b5adc2cf5b551827dc8bfd09c 2023-07-12 22:14:56,120 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for aa2d3a2b5adc2cf5b551827dc8bfd09c 2023-07-12 22:14:56,122 INFO [StoreOpener-aa2d3a2b5adc2cf5b551827dc8bfd09c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region aa2d3a2b5adc2cf5b551827dc8bfd09c 2023-07-12 22:14:56,127 INFO [StoreOpener-264b2f67c61eb0b9dcf6db2af575fe4b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 264b2f67c61eb0b9dcf6db2af575fe4b 2023-07-12 22:14:56,128 DEBUG [StoreOpener-aa2d3a2b5adc2cf5b551827dc8bfd09c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/aa2d3a2b5adc2cf5b551827dc8bfd09c/cf 2023-07-12 22:14:56,128 DEBUG [StoreOpener-aa2d3a2b5adc2cf5b551827dc8bfd09c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/aa2d3a2b5adc2cf5b551827dc8bfd09c/cf 2023-07-12 22:14:56,128 DEBUG [StoreOpener-264b2f67c61eb0b9dcf6db2af575fe4b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/264b2f67c61eb0b9dcf6db2af575fe4b/cf 2023-07-12 22:14:56,128 DEBUG [StoreOpener-264b2f67c61eb0b9dcf6db2af575fe4b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/264b2f67c61eb0b9dcf6db2af575fe4b/cf 2023-07-12 22:14:56,128 INFO [StoreOpener-aa2d3a2b5adc2cf5b551827dc8bfd09c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region aa2d3a2b5adc2cf5b551827dc8bfd09c columnFamilyName cf 2023-07-12 22:14:56,129 INFO [StoreOpener-264b2f67c61eb0b9dcf6db2af575fe4b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 264b2f67c61eb0b9dcf6db2af575fe4b columnFamilyName cf 2023-07-12 22:14:56,129 INFO [StoreOpener-aa2d3a2b5adc2cf5b551827dc8bfd09c-1] regionserver.HStore(310): Store=aa2d3a2b5adc2cf5b551827dc8bfd09c/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 22:14:56,130 INFO [StoreOpener-264b2f67c61eb0b9dcf6db2af575fe4b-1] regionserver.HStore(310): Store=264b2f67c61eb0b9dcf6db2af575fe4b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 22:14:56,130 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/aa2d3a2b5adc2cf5b551827dc8bfd09c 2023-07-12 22:14:56,131 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/aa2d3a2b5adc2cf5b551827dc8bfd09c 2023-07-12 22:14:56,131 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/264b2f67c61eb0b9dcf6db2af575fe4b 2023-07-12 22:14:56,131 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/264b2f67c61eb0b9dcf6db2af575fe4b 2023-07-12 22:14:56,134 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for aa2d3a2b5adc2cf5b551827dc8bfd09c 2023-07-12 22:14:56,135 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 264b2f67c61eb0b9dcf6db2af575fe4b 2023-07-12 22:14:56,146 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/aa2d3a2b5adc2cf5b551827dc8bfd09c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 22:14:56,147 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/264b2f67c61eb0b9dcf6db2af575fe4b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 22:14:56,148 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened aa2d3a2b5adc2cf5b551827dc8bfd09c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61386173, jitterRate=-0.08527474105358124}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 22:14:56,148 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for aa2d3a2b5adc2cf5b551827dc8bfd09c: 2023-07-12 22:14:56,148 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 264b2f67c61eb0b9dcf6db2af575fe4b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66572078, jitterRate=-0.007998734712600708}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 22:14:56,148 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 264b2f67c61eb0b9dcf6db2af575fe4b: 2023-07-12 22:14:56,149 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689200095665.264b2f67c61eb0b9dcf6db2af575fe4b., pid=69, masterSystemTime=1689200096076 2023-07-12 22:14:56,149 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689200095665.aa2d3a2b5adc2cf5b551827dc8bfd09c., pid=70, masterSystemTime=1689200096076 2023-07-12 22:14:56,151 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689200095665.264b2f67c61eb0b9dcf6db2af575fe4b. 2023-07-12 22:14:56,151 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1689200095665.264b2f67c61eb0b9dcf6db2af575fe4b. 2023-07-12 22:14:56,152 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=264b2f67c61eb0b9dcf6db2af575fe4b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:56,152 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689200095665.aa2d3a2b5adc2cf5b551827dc8bfd09c. 2023-07-12 22:14:56,152 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689200095665.aa2d3a2b5adc2cf5b551827dc8bfd09c. 2023-07-12 22:14:56,153 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689200095665.264b2f67c61eb0b9dcf6db2af575fe4b.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689200096152"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689200096152"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689200096152"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689200096152"}]},"ts":"1689200096152"} 2023-07-12 22:14:56,154 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=aa2d3a2b5adc2cf5b551827dc8bfd09c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:14:56,154 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689200095665.aa2d3a2b5adc2cf5b551827dc8bfd09c.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689200096154"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689200096154"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689200096154"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689200096154"}]},"ts":"1689200096154"} 2023-07-12 22:14:56,159 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=68 2023-07-12 22:14:56,159 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=68, state=SUCCESS; OpenRegionProcedure 264b2f67c61eb0b9dcf6db2af575fe4b, server=jenkins-hbase4.apache.org,37349,1689200016037 in 232 msec 2023-07-12 22:14:56,160 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=70, resume processing ppid=67 2023-07-12 22:14:56,160 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=70, ppid=67, state=SUCCESS; OpenRegionProcedure aa2d3a2b5adc2cf5b551827dc8bfd09c, server=jenkins-hbase4.apache.org,34497,1689200016186 in 232 msec 2023-07-12 22:14:56,161 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=264b2f67c61eb0b9dcf6db2af575fe4b, ASSIGN in 393 msec 2023-07-12 22:14:56,163 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=67, resume processing ppid=66 2023-07-12 22:14:56,163 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=aa2d3a2b5adc2cf5b551827dc8bfd09c, ASSIGN in 394 msec 2023-07-12 22:14:56,163 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 22:14:56,164 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689200096164"}]},"ts":"1689200096164"} 2023-07-12 22:14:56,165 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-07-12 22:14:56,169 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 22:14:56,170 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-07-12 22:14:56,175 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34497] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-12 22:14:56,178 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 22:14:56,178 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 22:14:56,178 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 22:14:56,181 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 22:14:56,181 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 22:14:56,181 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-12 22:14:56,181 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-12 22:14:56,182 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 22:14:56,184 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 22:14:56,184 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-12 22:14:56,185 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 22:14:56,185 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-12 22:14:56,185 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 517 msec 2023-07-12 22:14:56,274 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-12 22:14:56,274 INFO [Listener at jenkins-hbase4.apache.org/41531] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-07-12 22:14:56,310 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions aa2d3a2b5adc2cf5b551827dc8bfd09c, 264b2f67c61eb0b9dcf6db2af575fe4b 2023-07-12 22:14:56,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[aa2d3a2b5adc2cf5b551827dc8bfd09c, 264b2f67c61eb0b9dcf6db2af575fe4b], force=true 2023-07-12 22:14:56,326 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[aa2d3a2b5adc2cf5b551827dc8bfd09c, 264b2f67c61eb0b9dcf6db2af575fe4b], force=true 2023-07-12 22:14:56,326 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[aa2d3a2b5adc2cf5b551827dc8bfd09c, 264b2f67c61eb0b9dcf6db2af575fe4b], force=true 2023-07-12 22:14:56,326 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[aa2d3a2b5adc2cf5b551827dc8bfd09c, 264b2f67c61eb0b9dcf6db2af575fe4b], force=true 2023-07-12 22:14:56,329 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-12 22:14:56,368 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=aa2d3a2b5adc2cf5b551827dc8bfd09c, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=264b2f67c61eb0b9dcf6db2af575fe4b, UNASSIGN}] 2023-07-12 22:14:56,370 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=aa2d3a2b5adc2cf5b551827dc8bfd09c, UNASSIGN 2023-07-12 22:14:56,371 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=aa2d3a2b5adc2cf5b551827dc8bfd09c, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:14:56,372 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689200095665.aa2d3a2b5adc2cf5b551827dc8bfd09c.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689200096371"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689200096371"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689200096371"}]},"ts":"1689200096371"} 2023-07-12 22:14:56,375 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=264b2f67c61eb0b9dcf6db2af575fe4b, UNASSIGN 2023-07-12 22:14:56,376 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=74, ppid=72, state=RUNNABLE; CloseRegionProcedure aa2d3a2b5adc2cf5b551827dc8bfd09c, server=jenkins-hbase4.apache.org,34497,1689200016186}] 2023-07-12 22:14:56,376 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=264b2f67c61eb0b9dcf6db2af575fe4b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:56,377 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689200095665.264b2f67c61eb0b9dcf6db2af575fe4b.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689200096376"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689200096376"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689200096376"}]},"ts":"1689200096376"} 2023-07-12 22:14:56,378 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=75, ppid=73, state=RUNNABLE; CloseRegionProcedure 264b2f67c61eb0b9dcf6db2af575fe4b, server=jenkins-hbase4.apache.org,37349,1689200016037}] 2023-07-12 22:14:56,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-12 22:14:56,529 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close aa2d3a2b5adc2cf5b551827dc8bfd09c 2023-07-12 22:14:56,532 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing aa2d3a2b5adc2cf5b551827dc8bfd09c, disabling compactions & flushes 2023-07-12 22:14:56,532 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689200095665.aa2d3a2b5adc2cf5b551827dc8bfd09c. 2023-07-12 22:14:56,532 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689200095665.aa2d3a2b5adc2cf5b551827dc8bfd09c. 2023-07-12 22:14:56,532 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689200095665.aa2d3a2b5adc2cf5b551827dc8bfd09c. after waiting 0 ms 2023-07-12 22:14:56,532 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689200095665.aa2d3a2b5adc2cf5b551827dc8bfd09c. 2023-07-12 22:14:56,532 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing aa2d3a2b5adc2cf5b551827dc8bfd09c 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-12 22:14:56,532 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 264b2f67c61eb0b9dcf6db2af575fe4b 2023-07-12 22:14:56,534 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 264b2f67c61eb0b9dcf6db2af575fe4b, disabling compactions & flushes 2023-07-12 22:14:56,534 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689200095665.264b2f67c61eb0b9dcf6db2af575fe4b. 2023-07-12 22:14:56,535 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689200095665.264b2f67c61eb0b9dcf6db2af575fe4b. 2023-07-12 22:14:56,535 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689200095665.264b2f67c61eb0b9dcf6db2af575fe4b. after waiting 0 ms 2023-07-12 22:14:56,535 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689200095665.264b2f67c61eb0b9dcf6db2af575fe4b. 2023-07-12 22:14:56,535 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 264b2f67c61eb0b9dcf6db2af575fe4b 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-12 22:14:56,603 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/aa2d3a2b5adc2cf5b551827dc8bfd09c/.tmp/cf/0e2b164058a44d3ba2c075cacab193f2 2023-07-12 22:14:56,606 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/264b2f67c61eb0b9dcf6db2af575fe4b/.tmp/cf/c1c640719cd84517a8ee45ba265373a3 2023-07-12 22:14:56,620 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/264b2f67c61eb0b9dcf6db2af575fe4b/.tmp/cf/c1c640719cd84517a8ee45ba265373a3 as hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/264b2f67c61eb0b9dcf6db2af575fe4b/cf/c1c640719cd84517a8ee45ba265373a3 2023-07-12 22:14:56,620 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/aa2d3a2b5adc2cf5b551827dc8bfd09c/.tmp/cf/0e2b164058a44d3ba2c075cacab193f2 as hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/aa2d3a2b5adc2cf5b551827dc8bfd09c/cf/0e2b164058a44d3ba2c075cacab193f2 2023-07-12 22:14:56,627 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/264b2f67c61eb0b9dcf6db2af575fe4b/cf/c1c640719cd84517a8ee45ba265373a3, entries=1, sequenceid=5, filesize=4.7 K 2023-07-12 22:14:56,630 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 264b2f67c61eb0b9dcf6db2af575fe4b in 95ms, sequenceid=5, compaction requested=false 2023-07-12 22:14:56,630 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-07-12 22:14:56,632 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-12 22:14:56,634 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/aa2d3a2b5adc2cf5b551827dc8bfd09c/cf/0e2b164058a44d3ba2c075cacab193f2, entries=1, sequenceid=5, filesize=4.7 K 2023-07-12 22:14:56,638 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for aa2d3a2b5adc2cf5b551827dc8bfd09c in 106ms, sequenceid=5, compaction requested=false 2023-07-12 22:14:56,645 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/264b2f67c61eb0b9dcf6db2af575fe4b/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-12 22:14:56,645 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/aa2d3a2b5adc2cf5b551827dc8bfd09c/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-12 22:14:56,646 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 22:14:56,646 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 22:14:56,646 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689200095665.264b2f67c61eb0b9dcf6db2af575fe4b. 2023-07-12 22:14:56,646 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689200095665.aa2d3a2b5adc2cf5b551827dc8bfd09c. 2023-07-12 22:14:56,646 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 264b2f67c61eb0b9dcf6db2af575fe4b: 2023-07-12 22:14:56,646 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for aa2d3a2b5adc2cf5b551827dc8bfd09c: 2023-07-12 22:14:56,649 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 264b2f67c61eb0b9dcf6db2af575fe4b 2023-07-12 22:14:56,655 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=264b2f67c61eb0b9dcf6db2af575fe4b, regionState=CLOSED 2023-07-12 22:14:56,655 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689200095665.264b2f67c61eb0b9dcf6db2af575fe4b.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689200096655"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689200096655"}]},"ts":"1689200096655"} 2023-07-12 22:14:56,655 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed aa2d3a2b5adc2cf5b551827dc8bfd09c 2023-07-12 22:14:56,658 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=aa2d3a2b5adc2cf5b551827dc8bfd09c, regionState=CLOSED 2023-07-12 22:14:56,658 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689200095665.aa2d3a2b5adc2cf5b551827dc8bfd09c.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689200096658"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689200096658"}]},"ts":"1689200096658"} 2023-07-12 22:14:56,660 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=75, resume processing ppid=73 2023-07-12 22:14:56,660 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=75, ppid=73, state=SUCCESS; CloseRegionProcedure 264b2f67c61eb0b9dcf6db2af575fe4b, server=jenkins-hbase4.apache.org,37349,1689200016037 in 280 msec 2023-07-12 22:14:56,663 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=264b2f67c61eb0b9dcf6db2af575fe4b, UNASSIGN in 292 msec 2023-07-12 22:14:56,664 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=74, resume processing ppid=72 2023-07-12 22:14:56,664 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=74, ppid=72, state=SUCCESS; CloseRegionProcedure aa2d3a2b5adc2cf5b551827dc8bfd09c, server=jenkins-hbase4.apache.org,34497,1689200016186 in 284 msec 2023-07-12 22:14:56,670 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=72, resume processing ppid=71 2023-07-12 22:14:56,671 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=aa2d3a2b5adc2cf5b551827dc8bfd09c, UNASSIGN in 303 msec 2023-07-12 22:14:56,763 DEBUG [PEWorker-2] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4b7c460526698fd964dba3e0e83708fd/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-07-12 22:14:56,770 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689200095665.aa2d3a2b5adc2cf5b551827dc8bfd09c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-12 22:14:56,771 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689200095665.264b2f67c61eb0b9dcf6db2af575fe4b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-12 22:14:56,771 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689200095666.4b7c460526698fd964dba3e0e83708fd.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-12 22:14:56,833 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4b7c460526698fd964dba3e0e83708fd, ASSIGN}] 2023-07-12 22:14:56,834 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4b7c460526698fd964dba3e0e83708fd, ASSIGN 2023-07-12 22:14:56,834 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4b7c460526698fd964dba3e0e83708fd, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,34497,1689200016186; forceNewPlan=false, retain=false 2023-07-12 22:14:56,934 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-12 22:14:56,985 INFO [jenkins-hbase4:43225] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-12 22:14:56,987 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=4b7c460526698fd964dba3e0e83708fd, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:14:56,987 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689200095666.4b7c460526698fd964dba3e0e83708fd.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689200096987"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689200096987"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689200096987"}]},"ts":"1689200096987"} 2023-07-12 22:14:56,990 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure 4b7c460526698fd964dba3e0e83708fd, server=jenkins-hbase4.apache.org,34497,1689200016186}] 2023-07-12 22:14:57,146 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689200095666.4b7c460526698fd964dba3e0e83708fd. 2023-07-12 22:14:57,146 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4b7c460526698fd964dba3e0e83708fd, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689200095666.4b7c460526698fd964dba3e0e83708fd.', STARTKEY => '', ENDKEY => ''} 2023-07-12 22:14:57,147 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689200095666.4b7c460526698fd964dba3e0e83708fd. service=AccessControlService 2023-07-12 22:14:57,147 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 22:14:57,147 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 4b7c460526698fd964dba3e0e83708fd 2023-07-12 22:14:57,147 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689200095666.4b7c460526698fd964dba3e0e83708fd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 22:14:57,147 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 4b7c460526698fd964dba3e0e83708fd 2023-07-12 22:14:57,147 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 4b7c460526698fd964dba3e0e83708fd 2023-07-12 22:14:57,149 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4b7c460526698fd964dba3e0e83708fd/.regioninfo 2023-07-12 22:14:57,172 INFO [StoreOpener-4b7c460526698fd964dba3e0e83708fd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 4b7c460526698fd964dba3e0e83708fd 2023-07-12 22:14:57,173 DEBUG [StoreOpener-4b7c460526698fd964dba3e0e83708fd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4b7c460526698fd964dba3e0e83708fd/cf 2023-07-12 22:14:57,173 DEBUG [StoreOpener-4b7c460526698fd964dba3e0e83708fd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4b7c460526698fd964dba3e0e83708fd/cf 2023-07-12 22:14:57,175 INFO [StoreOpener-4b7c460526698fd964dba3e0e83708fd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4b7c460526698fd964dba3e0e83708fd columnFamilyName cf 2023-07-12 22:14:57,234 DEBUG [StoreOpener-4b7c460526698fd964dba3e0e83708fd-1] regionserver.HStore(539): loaded hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4b7c460526698fd964dba3e0e83708fd/cf/0e2b164058a44d3ba2c075cacab193f2.aa2d3a2b5adc2cf5b551827dc8bfd09c->hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/aa2d3a2b5adc2cf5b551827dc8bfd09c/cf/0e2b164058a44d3ba2c075cacab193f2-top 2023-07-12 22:14:57,241 DEBUG [StoreOpener-4b7c460526698fd964dba3e0e83708fd-1] regionserver.HStore(539): loaded hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4b7c460526698fd964dba3e0e83708fd/cf/c1c640719cd84517a8ee45ba265373a3.264b2f67c61eb0b9dcf6db2af575fe4b->hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/264b2f67c61eb0b9dcf6db2af575fe4b/cf/c1c640719cd84517a8ee45ba265373a3-top 2023-07-12 22:14:57,242 INFO [StoreOpener-4b7c460526698fd964dba3e0e83708fd-1] regionserver.HStore(310): Store=4b7c460526698fd964dba3e0e83708fd/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 22:14:57,243 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4b7c460526698fd964dba3e0e83708fd 2023-07-12 22:14:57,244 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4b7c460526698fd964dba3e0e83708fd 2023-07-12 22:14:57,252 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 4b7c460526698fd964dba3e0e83708fd 2023-07-12 22:14:57,253 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 4b7c460526698fd964dba3e0e83708fd; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59543475, jitterRate=-0.11273308098316193}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 22:14:57,253 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 4b7c460526698fd964dba3e0e83708fd: 2023-07-12 22:14:57,253 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689200095666.4b7c460526698fd964dba3e0e83708fd., pid=77, masterSystemTime=1689200097142 2023-07-12 22:14:57,254 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1689200095666.4b7c460526698fd964dba3e0e83708fd.,because compaction is disabled. 2023-07-12 22:14:57,256 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689200095666.4b7c460526698fd964dba3e0e83708fd. 2023-07-12 22:14:57,256 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689200095666.4b7c460526698fd964dba3e0e83708fd. 2023-07-12 22:14:57,256 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=4b7c460526698fd964dba3e0e83708fd, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:14:57,256 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689200095666.4b7c460526698fd964dba3e0e83708fd.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689200097256"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689200097256"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689200097256"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689200097256"}]},"ts":"1689200097256"} 2023-07-12 22:14:57,259 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-07-12 22:14:57,260 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure 4b7c460526698fd964dba3e0e83708fd, server=jenkins-hbase4.apache.org,34497,1689200016186 in 268 msec 2023-07-12 22:14:57,261 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=71 2023-07-12 22:14:57,261 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4b7c460526698fd964dba3e0e83708fd, ASSIGN in 427 msec 2023-07-12 22:14:57,263 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[aa2d3a2b5adc2cf5b551827dc8bfd09c, 264b2f67c61eb0b9dcf6db2af575fe4b], force=true in 946 msec 2023-07-12 22:14:57,435 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-12 22:14:57,435 INFO [Listener at jenkins-hbase4.apache.org/41531] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-07-12 22:14:57,436 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-12 22:14:57,437 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689200097437 (current time:1689200097437). 2023-07-12 22:14:57,437 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 22:14:57,437 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] zookeeper.ReadOnlyZKClient(139): Connect 0x3c240096 to 127.0.0.1:62393 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 22:14:57,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7f0ea126, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 22:14:57,460 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 22:14:57,464 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50574, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 22:14:57,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3c240096 to 127.0.0.1:62393 2023-07-12 22:14:57,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 22:14:57,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] zookeeper.ReadOnlyZKClient(139): Connect 0x4ccb6257 to 127.0.0.1:62393 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 22:14:57,486 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689200025069_0004_000001 (auth:SIMPLE) 2023-07-12 22:14:57,489 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5077fbe8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 22:14:57,593 DEBUG [hconnection-0x5a7a7751-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 22:14:57,597 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50576, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 22:14:57,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 22:14:57,606 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42894, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 22:14:57,608 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4ccb6257 to 127.0.0.1:62393 2023-07-12 22:14:57,608 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 22:14:57,608 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-12 22:14:57,609 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 22:14:57,609 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-12 22:14:57,614 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-12 22:14:57,616 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-12 22:14:57,617 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1689200697617 2023-07-12 22:14:57,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-12 22:14:57,618 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:57,618 DEBUG [Listener at jenkins-hbase4.apache.org/41531] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 22:14:57,623 DEBUG [Listener at jenkins-hbase4.apache.org/41531] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 22:14:57,624 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-12 22:14:57,625 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-12 22:14:57,626 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 11 msec 2023-07-12 22:14:57,627 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-12 22:14:57,628 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1689200697628 2023-07-12 22:14:57,661 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:57,661 INFO [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-07-12 22:14:57,661 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 22:14:57,663 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-07-12 22:14:57,663 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-07-12 22:14:57,715 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:57,715 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:57,716 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:14:57,716 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:14:57,717 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:14:57,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:14:57,717 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:14:57,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:14:57,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:57,717 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:14:57,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:57,717 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:14:57,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:14:57,717 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:14:57,718 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:57,718 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:57,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:57,718 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:14:57,718 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 22:14:57,718 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:57,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-12 22:14:57,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:57,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-12 22:14:57,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:57,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-12 22:14:57,719 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-12 22:14:57,719 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-12 22:14:57,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:57,719 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-12 22:14:57,723 DEBUG [Listener at jenkins-hbase4.apache.org/41531] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 22:14:57,724 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-12 22:14:57,724 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-12 22:14:57,725 DEBUG [Listener at jenkins-hbase4.apache.org/41531] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 22:14:57,734 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:57,734 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-12 22:14:57,734 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 22:14:57,738 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:57,740 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:57,739 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-12 22:14:57,740 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-12 22:14:57,740 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-12 22:14:57,740 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 22:14:57,740 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-12 22:14:57,742 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-12 22:14:57,742 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40411,1689200016125' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-12 22:14:57,740 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 22:14:57,742 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-12 22:14:57,743 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-12 22:14:57,743 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-12 22:14:57,743 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34497,1689200016186' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-12 22:14:57,743 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37349,1689200016037' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-12 22:14:57,745 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:57,746 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:57,746 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:57,746 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 22:14:57,746 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:57,746 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 22:14:57,749 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:14:57,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:14:57,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 22:14:57,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 22:14:57,750 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:57,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 22:14:57,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 22:14:57,751 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:57,751 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 22:14:57,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:57,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:14:57,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:14:57,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:57,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 22:14:57,753 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34497,1689200016186' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-07-12 22:14:57,753 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@44e1c8e8[Count = 0] remaining members to acquire global barrier 2023-07-12 22:14:57,753 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-07-12 22:14:57,753 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:57,755 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:57,755 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:57,755 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:57,755 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:57,756 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:57,756 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:57,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:57,756 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:14:57,756 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-12 22:14:57,756 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 22:14:57,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:57,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:57,756 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-12 22:14:57,756 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-12 22:14:57,756 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-12 22:14:57,756 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-12 22:14:57,756 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,40411,1689200016125' in zk 2023-07-12 22:14:57,756 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,37349,1689200016037' in zk 2023-07-12 22:14:57,760 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-12 22:14:57,760 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 22:14:57,760 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-12 22:14:57,760 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-12 22:14:57,760 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 22:14:57,760 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-12 22:14:57,760 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 22:14:57,760 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 22:14:57,771 DEBUG [rs(jenkins-hbase4.apache.org,34497,1689200016186)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689200095666.4b7c460526698fd964dba3e0e83708fd. 2023-07-12 22:14:57,771 DEBUG [rs(jenkins-hbase4.apache.org,34497,1689200016186)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689200095666.4b7c460526698fd964dba3e0e83708fd. started... 2023-07-12 22:14:57,773 DEBUG [rs(jenkins-hbase4.apache.org,34497,1689200016186)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4b7c460526698fd964dba3e0e83708fd: 2023-07-12 22:14:57,773 DEBUG [rs(jenkins-hbase4.apache.org,34497,1689200016186)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689200095666.4b7c460526698fd964dba3e0e83708fd.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:57,773 DEBUG [rs(jenkins-hbase4.apache.org,34497,1689200016186)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 22:14:57,774 DEBUG [rs(jenkins-hbase4.apache.org,34497,1689200016186)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4b7c460526698fd964dba3e0e83708fd/cf/0e2b164058a44d3ba2c075cacab193f2.aa2d3a2b5adc2cf5b551827dc8bfd09c->hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/aa2d3a2b5adc2cf5b551827dc8bfd09c/cf/0e2b164058a44d3ba2c075cacab193f2-top, hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4b7c460526698fd964dba3e0e83708fd/cf/c1c640719cd84517a8ee45ba265373a3.264b2f67c61eb0b9dcf6db2af575fe4b->hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/264b2f67c61eb0b9dcf6db2af575fe4b/cf/c1c640719cd84517a8ee45ba265373a3-top] hfiles 2023-07-12 22:14:57,774 DEBUG [rs(jenkins-hbase4.apache.org,34497,1689200016186)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4b7c460526698fd964dba3e0e83708fd/cf/0e2b164058a44d3ba2c075cacab193f2.aa2d3a2b5adc2cf5b551827dc8bfd09c for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:57,775 DEBUG [rs(jenkins-hbase4.apache.org,34497,1689200016186)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4b7c460526698fd964dba3e0e83708fd/cf/c1c640719cd84517a8ee45ba265373a3.264b2f67c61eb0b9dcf6db2af575fe4b for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:57,802 DEBUG [rs(jenkins-hbase4.apache.org,34497,1689200016186)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689200095666.4b7c460526698fd964dba3e0e83708fd. completed. 2023-07-12 22:14:57,802 DEBUG [rs(jenkins-hbase4.apache.org,34497,1689200016186)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689200095666.4b7c460526698fd964dba3e0e83708fd. 2023-07-12 22:14:57,802 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 22:14:57,802 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 22:14:57,802 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:14:57,802 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-12 22:14:57,802 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,34497,1689200016186' in zk 2023-07-12 22:14:57,809 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-12 22:14:57,810 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:14:57,810 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 22:14:57,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:14:57,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 22:14:57,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 22:14:57,810 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-12 22:14:57,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 22:14:57,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 22:14:57,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:57,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:14:57,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:14:57,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:57,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 22:14:57,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:57,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:14:57,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:14:57,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:57,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,34497,1689200016186': 2023-07-12 22:14:57,814 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34497,1689200016186' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-07-12 22:14:57,814 INFO [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-07-12 22:14:57,815 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 22:14:57,815 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 22:14:57,815 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:57,815 INFO [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 22:14:57,816 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:57,816 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:14:57,817 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:57,817 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:57,817 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:57,817 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:57,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:57,817 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:57,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:57,817 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:14:57,817 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:14:57,817 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:57,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:57,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:57,817 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:14:57,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:14:57,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 22:14:57,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 22:14:57,817 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:14:57,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:14:57,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:57,817 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:14:57,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:14:57,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:57,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 22:14:57,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:57,818 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:14:57,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:57,819 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:14:57,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 22:14:57,819 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:57,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:57,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:14:57,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:14:57,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:57,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 22:14:57,821 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:14:57,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:57,821 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:14:57,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:14:57,822 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:57,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:14:57,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:57,825 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:14:57,825 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:14:57,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:14:57,826 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:14:57,826 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:14:57,826 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 22:14:57,826 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:14:57,826 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:14:57,826 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:14:57,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:14:57,826 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:14:57,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:14:57,826 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:14:57,826 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:57,827 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:57,828 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:57,832 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:57,832 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:57,832 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:14:57,832 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:14:57,832 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:57,832 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:14:57,832 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:57,832 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:14:57,832 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:14:57,832 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:57,832 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:57,833 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:14:57,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:14:57,833 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:14:57,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:14:57,834 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:14:57,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:14:57,925 DEBUG [Listener at jenkins-hbase4.apache.org/41531] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 22:14:57,927 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-12 22:14:57,927 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-12 22:14:57,927 DEBUG [Listener at jenkins-hbase4.apache.org/41531] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-12 22:14:57,959 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:58,013 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-07-12 22:14:58,014 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:58,014 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:58,014 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1689200097618Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689200097827 (+209 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689200097827Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689200097839 (+12 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689200097935 (+96 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1689200098013 (+78 ms) 2023-07-12 22:14:58,018 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-12 22:14:58,019 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 396 msec 2023-07-12 22:14:58,227 DEBUG [Listener at jenkins-hbase4.apache.org/41531] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 22:14:58,229 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-12 22:14:58,229 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 22:14:58,229 INFO [Listener at jenkins-hbase4.apache.org/41531] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/export-test/export-1689200098229 2023-07-12 22:14:58,229 INFO [Listener at jenkins-hbase4.apache.org/41531] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:34335, tgtDir=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/export-test/export-1689200098229, rawTgtDir=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/export-test/export-1689200098229, srcFsUri=hdfs://localhost:34335, srcDir=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967 2023-07-12 22:14:58,273 DEBUG [Listener at jenkins-hbase4.apache.org/41531] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:34335, inputRoot=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967 2023-07-12 22:14:58,274 DEBUG [Listener at jenkins-hbase4.apache.org/41531] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_447533808_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/export-test/export-1689200098229, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/export-test/export-1689200098229/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:58,274 INFO [Listener at jenkins-hbase4.apache.org/41531] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:34335, inputRoot=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967, snapshotDir=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-07-12 22:14:58,307 INFO [Listener at jenkins-hbase4.apache.org/41531] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/export-test/export-1689200098229/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:58,438 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-12 22:14:58,439 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-12 22:14:58,439 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-12 22:14:58,440 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-12 22:14:58,440 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-12 22:14:58,441 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-12 22:14:58,441 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-12 22:14:58,569 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/652e6e64-efb3-f860-57fa-f551f44ecb6b/hadoop-6409189413601637528.jar 2023-07-12 22:14:58,570 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-12 22:14:58,570 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-12 22:14:58,571 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-12 22:14:58,571 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-12 22:14:58,572 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-12 22:14:58,572 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-12 22:14:58,573 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-12 22:14:58,573 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-12 22:14:58,574 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-12 22:14:58,574 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-12 22:14:58,575 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-12 22:14:58,575 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-12 22:14:58,576 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-12 22:14:58,576 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-12 22:14:58,577 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-12 22:14:58,578 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-12 22:14:58,578 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 22:14:58,579 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 22:14:58,579 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 22:14:58,580 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 22:14:58,580 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 22:14:58,581 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 22:14:58,581 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 22:14:58,804 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-12 22:15:00,048 WARN [Listener at jenkins-hbase4.apache.org/41531] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-12 22:15:00,051 INFO [Listener at jenkins-hbase4.apache.org/41531] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-07-12 22:15:00,053 DEBUG [Listener at jenkins-hbase4.apache.org/41531] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-07-12 22:15:00,152 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 22:15:00,153 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 22:15:00,489 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689200025069_0005_000001 (auth:SIMPLE) 2023-07-12 22:15:06,606 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689200025069_0005_000001 (auth:SIMPLE) 2023-07-12 22:15:08,917 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689200025069_0005_000001 (auth:SIMPLE) 2023-07-12 22:15:12,694 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689200025069_0005_000001 (auth:SIMPLE) 2023-07-12 22:15:14,336 INFO [Listener at jenkins-hbase4.apache.org/41531] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-12 22:15:14,339 INFO [Listener at jenkins-hbase4.apache.org/41531] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-12 22:15:14,349 INFO [Listener at jenkins-hbase4.apache.org/41531] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:15:14,350 INFO [Listener at jenkins-hbase4.apache.org/41531] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-12 22:15:14,350 INFO [Listener at jenkins-hbase4.apache.org/41531] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-12 22:15:14,351 DEBUG [Listener at jenkins-hbase4.apache.org/41531] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1346150702_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:15:14,351 DEBUG [Listener at jenkins-hbase4.apache.org/41531] snapshot.TestExportSnapshot(367): hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-12 22:15:14,351 DEBUG [Listener at jenkins-hbase4.apache.org/41531] snapshot.TestExportSnapshot(367): hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-12 22:15:14,351 DEBUG [Listener at jenkins-hbase4.apache.org/41531] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1346150702_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/export-test/export-1689200098229/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/export-test/export-1689200098229/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:15:14,352 DEBUG [Listener at jenkins-hbase4.apache.org/41531] snapshot.TestExportSnapshot(367): hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/export-test/export-1689200098229/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-12 22:15:14,352 DEBUG [Listener at jenkins-hbase4.apache.org/41531] snapshot.TestExportSnapshot(367): hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/export-test/export-1689200098229/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-12 22:15:14,359 INFO [Listener at jenkins-hbase4.apache.org/41531] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:15:14,359 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:15:14,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] procedure2.ProcedureExecutor(1029): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:15:14,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-12 22:15:14,364 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689200114364"}]},"ts":"1689200114364"} 2023-07-12 22:15:14,365 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-07-12 22:15:14,368 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-07-12 22:15:14,369 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4b7c460526698fd964dba3e0e83708fd, UNASSIGN}] 2023-07-12 22:15:14,371 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4b7c460526698fd964dba3e0e83708fd, UNASSIGN 2023-07-12 22:15:14,373 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=4b7c460526698fd964dba3e0e83708fd, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:15:14,373 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689200095666.4b7c460526698fd964dba3e0e83708fd.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689200114373"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689200114373"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689200114373"}]},"ts":"1689200114373"} 2023-07-12 22:15:14,374 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure 4b7c460526698fd964dba3e0e83708fd, server=jenkins-hbase4.apache.org,34497,1689200016186}] 2023-07-12 22:15:14,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-12 22:15:14,528 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 4b7c460526698fd964dba3e0e83708fd 2023-07-12 22:15:14,528 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 4b7c460526698fd964dba3e0e83708fd, disabling compactions & flushes 2023-07-12 22:15:14,528 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689200095666.4b7c460526698fd964dba3e0e83708fd. 2023-07-12 22:15:14,528 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689200095666.4b7c460526698fd964dba3e0e83708fd. 2023-07-12 22:15:14,528 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689200095666.4b7c460526698fd964dba3e0e83708fd. after waiting 0 ms 2023-07-12 22:15:14,528 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689200095666.4b7c460526698fd964dba3e0e83708fd. 2023-07-12 22:15:14,544 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4b7c460526698fd964dba3e0e83708fd/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-07-12 22:15:14,545 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 22:15:14,546 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689200095666.4b7c460526698fd964dba3e0e83708fd. 2023-07-12 22:15:14,546 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 4b7c460526698fd964dba3e0e83708fd: 2023-07-12 22:15:14,548 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 4b7c460526698fd964dba3e0e83708fd 2023-07-12 22:15:14,549 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=4b7c460526698fd964dba3e0e83708fd, regionState=CLOSED 2023-07-12 22:15:14,549 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689200095666.4b7c460526698fd964dba3e0e83708fd.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689200114549"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689200114549"}]},"ts":"1689200114549"} 2023-07-12 22:15:14,555 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=82, resume processing ppid=81 2023-07-12 22:15:14,555 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure 4b7c460526698fd964dba3e0e83708fd, server=jenkins-hbase4.apache.org,34497,1689200016186 in 177 msec 2023-07-12 22:15:14,556 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=80 2023-07-12 22:15:14,557 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4b7c460526698fd964dba3e0e83708fd, UNASSIGN in 186 msec 2023-07-12 22:15:14,557 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689200114557"}]},"ts":"1689200114557"} 2023-07-12 22:15:14,559 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-07-12 22:15:14,560 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-07-12 22:15:14,562 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 202 msec 2023-07-12 22:15:14,667 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-12 22:15:14,667 INFO [Listener at jenkins-hbase4.apache.org/41531] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-07-12 22:15:14,668 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:15:14,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] procedure2.ProcedureExecutor(1029): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:15:14,672 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:15:14,674 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:15:14,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:15:14,676 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34497] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:15:14,680 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:15:14,680 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:15:14,680 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:15:14,680 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:15:14,681 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-12 22:15:14,681 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-12 22:15:14,681 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-12 22:15:14,681 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-12 22:15:14,683 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4b7c460526698fd964dba3e0e83708fd 2023-07-12 22:15:14,683 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/aa2d3a2b5adc2cf5b551827dc8bfd09c 2023-07-12 22:15:14,683 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/264b2f67c61eb0b9dcf6db2af575fe4b 2023-07-12 22:15:14,684 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:15:14,684 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 22:15:14,684 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:15:14,684 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 22:15:14,684 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:15:14,684 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 22:15:14,684 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:15:14,684 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 22:15:14,684 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 22:15:14,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-12 22:15:14,685 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 22:15:14,686 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 22:15:14,686 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 22:15:14,686 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/264b2f67c61eb0b9dcf6db2af575fe4b/cf, FileablePath, hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/264b2f67c61eb0b9dcf6db2af575fe4b/recovered.edits] 2023-07-12 22:15:14,687 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4b7c460526698fd964dba3e0e83708fd/cf, FileablePath, hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4b7c460526698fd964dba3e0e83708fd/recovered.edits] 2023-07-12 22:15:14,688 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/aa2d3a2b5adc2cf5b551827dc8bfd09c/cf, FileablePath, hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/aa2d3a2b5adc2cf5b551827dc8bfd09c/recovered.edits] 2023-07-12 22:15:14,694 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/264b2f67c61eb0b9dcf6db2af575fe4b/cf/c1c640719cd84517a8ee45ba265373a3 to hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/264b2f67c61eb0b9dcf6db2af575fe4b/cf/c1c640719cd84517a8ee45ba265373a3 2023-07-12 22:15:14,695 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/aa2d3a2b5adc2cf5b551827dc8bfd09c/cf/0e2b164058a44d3ba2c075cacab193f2 to hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/aa2d3a2b5adc2cf5b551827dc8bfd09c/cf/0e2b164058a44d3ba2c075cacab193f2 2023-07-12 22:15:14,695 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4b7c460526698fd964dba3e0e83708fd/cf/0e2b164058a44d3ba2c075cacab193f2.aa2d3a2b5adc2cf5b551827dc8bfd09c to hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4b7c460526698fd964dba3e0e83708fd/cf/0e2b164058a44d3ba2c075cacab193f2.aa2d3a2b5adc2cf5b551827dc8bfd09c 2023-07-12 22:15:14,698 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4b7c460526698fd964dba3e0e83708fd/cf/c1c640719cd84517a8ee45ba265373a3.264b2f67c61eb0b9dcf6db2af575fe4b to hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4b7c460526698fd964dba3e0e83708fd/cf/c1c640719cd84517a8ee45ba265373a3.264b2f67c61eb0b9dcf6db2af575fe4b 2023-07-12 22:15:14,700 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/264b2f67c61eb0b9dcf6db2af575fe4b/recovered.edits/8.seqid to hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/264b2f67c61eb0b9dcf6db2af575fe4b/recovered.edits/8.seqid 2023-07-12 22:15:14,700 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/264b2f67c61eb0b9dcf6db2af575fe4b 2023-07-12 22:15:14,702 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/aa2d3a2b5adc2cf5b551827dc8bfd09c/recovered.edits/8.seqid to hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/aa2d3a2b5adc2cf5b551827dc8bfd09c/recovered.edits/8.seqid 2023-07-12 22:15:14,703 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4b7c460526698fd964dba3e0e83708fd/recovered.edits/12.seqid to hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4b7c460526698fd964dba3e0e83708fd/recovered.edits/12.seqid 2023-07-12 22:15:14,703 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/aa2d3a2b5adc2cf5b551827dc8bfd09c 2023-07-12 22:15:14,704 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4b7c460526698fd964dba3e0e83708fd 2023-07-12 22:15:14,704 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-12 22:15:14,707 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:15:14,709 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-07-12 22:15:14,715 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-07-12 22:15:14,716 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:15:14,716 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-07-12 22:15:14,716 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689200095666.4b7c460526698fd964dba3e0e83708fd.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689200114716"}]},"ts":"9223372036854775807"} 2023-07-12 22:15:14,720 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-07-12 22:15:14,720 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 4b7c460526698fd964dba3e0e83708fd, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689200095666.4b7c460526698fd964dba3e0e83708fd.', STARTKEY => '', ENDKEY => ''}] 2023-07-12 22:15:14,720 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-07-12 22:15:14,720 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689200114720"}]},"ts":"9223372036854775807"} 2023-07-12 22:15:14,722 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-07-12 22:15:14,724 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:15:14,726 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 56 msec 2023-07-12 22:15:14,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-12 22:15:14,787 INFO [Listener at jenkins-hbase4.apache.org/41531] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-07-12 22:15:14,788 INFO [Listener at jenkins-hbase4.apache.org/41531] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 22:15:14,789 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 22:15:14,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] procedure2.ProcedureExecutor(1029): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 22:15:14,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-12 22:15:14,796 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689200114795"}]},"ts":"1689200114795"} 2023-07-12 22:15:14,797 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-07-12 22:15:14,799 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-07-12 22:15:14,799 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=ba1a7b21bb35eb9cc9d0a5d281ec91ed, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=15ba7a001fd5b7c3732c82989249f2d4, UNASSIGN}] 2023-07-12 22:15:14,800 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=ba1a7b21bb35eb9cc9d0a5d281ec91ed, UNASSIGN 2023-07-12 22:15:14,802 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=15ba7a001fd5b7c3732c82989249f2d4, UNASSIGN 2023-07-12 22:15:14,808 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=15ba7a001fd5b7c3732c82989249f2d4, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:15:14,808 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=ba1a7b21bb35eb9cc9d0a5d281ec91ed, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:15:14,808 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689200093507.15ba7a001fd5b7c3732c82989249f2d4.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689200114807"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689200114807"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689200114807"}]},"ts":"1689200114807"} 2023-07-12 22:15:14,808 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689200093507.ba1a7b21bb35eb9cc9d0a5d281ec91ed.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689200114807"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689200114807"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689200114807"}]},"ts":"1689200114807"} 2023-07-12 22:15:14,810 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=87, ppid=86, state=RUNNABLE; CloseRegionProcedure 15ba7a001fd5b7c3732c82989249f2d4, server=jenkins-hbase4.apache.org,40411,1689200016125}] 2023-07-12 22:15:14,811 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=88, ppid=85, state=RUNNABLE; CloseRegionProcedure ba1a7b21bb35eb9cc9d0a5d281ec91ed, server=jenkins-hbase4.apache.org,37349,1689200016037}] 2023-07-12 22:15:14,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-12 22:15:14,966 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 15ba7a001fd5b7c3732c82989249f2d4 2023-07-12 22:15:14,966 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close ba1a7b21bb35eb9cc9d0a5d281ec91ed 2023-07-12 22:15:14,966 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 15ba7a001fd5b7c3732c82989249f2d4, disabling compactions & flushes 2023-07-12 22:15:14,966 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ba1a7b21bb35eb9cc9d0a5d281ec91ed, disabling compactions & flushes 2023-07-12 22:15:14,966 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689200093507.15ba7a001fd5b7c3732c82989249f2d4. 2023-07-12 22:15:14,966 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689200093507.ba1a7b21bb35eb9cc9d0a5d281ec91ed. 2023-07-12 22:15:14,966 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689200093507.ba1a7b21bb35eb9cc9d0a5d281ec91ed. 2023-07-12 22:15:14,966 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689200093507.15ba7a001fd5b7c3732c82989249f2d4. 2023-07-12 22:15:14,967 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689200093507.ba1a7b21bb35eb9cc9d0a5d281ec91ed. after waiting 0 ms 2023-07-12 22:15:14,967 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689200093507.ba1a7b21bb35eb9cc9d0a5d281ec91ed. 2023-07-12 22:15:14,967 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689200093507.15ba7a001fd5b7c3732c82989249f2d4. after waiting 0 ms 2023-07-12 22:15:14,967 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689200093507.15ba7a001fd5b7c3732c82989249f2d4. 2023-07-12 22:15:14,976 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testExportFileSystemStateWithMergeRegion/15ba7a001fd5b7c3732c82989249f2d4/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 22:15:14,976 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testExportFileSystemStateWithMergeRegion/ba1a7b21bb35eb9cc9d0a5d281ec91ed/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 22:15:14,977 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 22:15:14,977 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 22:15:14,978 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689200093507.15ba7a001fd5b7c3732c82989249f2d4. 2023-07-12 22:15:14,978 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689200093507.ba1a7b21bb35eb9cc9d0a5d281ec91ed. 2023-07-12 22:15:14,978 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 15ba7a001fd5b7c3732c82989249f2d4: 2023-07-12 22:15:14,978 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ba1a7b21bb35eb9cc9d0a5d281ec91ed: 2023-07-12 22:15:14,979 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 15ba7a001fd5b7c3732c82989249f2d4 2023-07-12 22:15:14,980 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed ba1a7b21bb35eb9cc9d0a5d281ec91ed 2023-07-12 22:15:14,980 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=15ba7a001fd5b7c3732c82989249f2d4, regionState=CLOSED 2023-07-12 22:15:14,981 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689200093507.15ba7a001fd5b7c3732c82989249f2d4.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689200114980"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689200114980"}]},"ts":"1689200114980"} 2023-07-12 22:15:14,982 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=ba1a7b21bb35eb9cc9d0a5d281ec91ed, regionState=CLOSED 2023-07-12 22:15:14,982 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689200093507.ba1a7b21bb35eb9cc9d0a5d281ec91ed.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689200114982"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689200114982"}]},"ts":"1689200114982"} 2023-07-12 22:15:14,990 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=87, resume processing ppid=86 2023-07-12 22:15:14,990 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=87, ppid=86, state=SUCCESS; CloseRegionProcedure 15ba7a001fd5b7c3732c82989249f2d4, server=jenkins-hbase4.apache.org,40411,1689200016125 in 172 msec 2023-07-12 22:15:14,991 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=88, resume processing ppid=85 2023-07-12 22:15:14,991 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=88, ppid=85, state=SUCCESS; CloseRegionProcedure ba1a7b21bb35eb9cc9d0a5d281ec91ed, server=jenkins-hbase4.apache.org,37349,1689200016037 in 173 msec 2023-07-12 22:15:14,992 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=15ba7a001fd5b7c3732c82989249f2d4, UNASSIGN in 191 msec 2023-07-12 22:15:14,993 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=85, resume processing ppid=84 2023-07-12 22:15:14,993 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=ba1a7b21bb35eb9cc9d0a5d281ec91ed, UNASSIGN in 193 msec 2023-07-12 22:15:14,994 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689200114994"}]},"ts":"1689200114994"} 2023-07-12 22:15:14,995 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-07-12 22:15:14,997 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-07-12 22:15:14,999 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 209 msec 2023-07-12 22:15:15,098 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-12 22:15:15,098 INFO [Listener at jenkins-hbase4.apache.org/41531] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-07-12 22:15:15,099 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 22:15:15,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] procedure2.ProcedureExecutor(1029): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 22:15:15,103 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 22:15:15,103 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 22:15:15,105 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 22:15:15,106 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34497] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 22:15:15,110 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 22:15:15,110 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 22:15:15,110 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 22:15:15,111 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 22:15:15,111 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-12 22:15:15,111 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-12 22:15:15,111 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-12 22:15:15,112 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-12 22:15:15,112 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/15ba7a001fd5b7c3732c82989249f2d4 2023-07-12 22:15:15,112 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/ba1a7b21bb35eb9cc9d0a5d281ec91ed 2023-07-12 22:15:15,113 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 22:15:15,113 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 22:15:15,114 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 22:15:15,114 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 22:15:15,115 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 22:15:15,115 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 22:15:15,115 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 22:15:15,115 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 22:15:15,116 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/15ba7a001fd5b7c3732c82989249f2d4/cf, FileablePath, hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/15ba7a001fd5b7c3732c82989249f2d4/recovered.edits] 2023-07-12 22:15:15,118 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/ba1a7b21bb35eb9cc9d0a5d281ec91ed/cf, FileablePath, hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/ba1a7b21bb35eb9cc9d0a5d281ec91ed/recovered.edits] 2023-07-12 22:15:15,118 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-12 22:15:15,125 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/15ba7a001fd5b7c3732c82989249f2d4/cf/c71366b7bf45494f8dcc4bbb89f3db74 to hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/15ba7a001fd5b7c3732c82989249f2d4/cf/c71366b7bf45494f8dcc4bbb89f3db74 2023-07-12 22:15:15,126 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/ba1a7b21bb35eb9cc9d0a5d281ec91ed/cf/59d4bfc39f964194a41ab5b7d8f1ea3a to hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/ba1a7b21bb35eb9cc9d0a5d281ec91ed/cf/59d4bfc39f964194a41ab5b7d8f1ea3a 2023-07-12 22:15:15,131 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/15ba7a001fd5b7c3732c82989249f2d4/recovered.edits/9.seqid to hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/15ba7a001fd5b7c3732c82989249f2d4/recovered.edits/9.seqid 2023-07-12 22:15:15,132 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/15ba7a001fd5b7c3732c82989249f2d4 2023-07-12 22:15:15,133 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/ba1a7b21bb35eb9cc9d0a5d281ec91ed/recovered.edits/9.seqid to hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/ba1a7b21bb35eb9cc9d0a5d281ec91ed/recovered.edits/9.seqid 2023-07-12 22:15:15,134 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/ba1a7b21bb35eb9cc9d0a5d281ec91ed 2023-07-12 22:15:15,134 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-12 22:15:15,135 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-07-12 22:15:15,136 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf] 2023-07-12 22:15:15,140 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230712ae59ef169ffa4f0c856938424fdf14c8 to hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230712ae59ef169ffa4f0c856938424fdf14c8 2023-07-12 22:15:15,142 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e2023071267d4e4521d464d45837586d8fbf2abb4 to hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e2023071267d4e4521d464d45837586d8fbf2abb4 2023-07-12 22:15:15,143 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-07-12 22:15:15,147 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 22:15:15,159 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-07-12 22:15:15,167 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-07-12 22:15:15,169 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 22:15:15,169 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-07-12 22:15:15,169 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689200093507.ba1a7b21bb35eb9cc9d0a5d281ec91ed.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689200115169"}]},"ts":"9223372036854775807"} 2023-07-12 22:15:15,169 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689200093507.15ba7a001fd5b7c3732c82989249f2d4.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689200115169"}]},"ts":"9223372036854775807"} 2023-07-12 22:15:15,174 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-12 22:15:15,174 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => ba1a7b21bb35eb9cc9d0a5d281ec91ed, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689200093507.ba1a7b21bb35eb9cc9d0a5d281ec91ed.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 15ba7a001fd5b7c3732c82989249f2d4, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689200093507.15ba7a001fd5b7c3732c82989249f2d4.', STARTKEY => '1', ENDKEY => ''}] 2023-07-12 22:15:15,174 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-07-12 22:15:15,174 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689200115174"}]},"ts":"9223372036854775807"} 2023-07-12 22:15:15,179 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-07-12 22:15:15,181 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 22:15:15,182 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 82 msec 2023-07-12 22:15:15,220 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-12 22:15:15,220 INFO [Listener at jenkins-hbase4.apache.org/41531] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-07-12 22:15:15,231 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-12 22:15:15,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:15:15,235 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-12 22:15:15,237 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:15:15,245 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-07-12 22:15:15,248 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:15:15,295 INFO [Listener at jenkins-hbase4.apache.org/41531] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=758 (was 743) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x407c7a8e-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x407c7a8e-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x407c7a8e-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1346150702_17 at /127.0.0.1:42488 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x407c7a8e-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x407c7a8e-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-3986 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1346150702_17 at /127.0.0.1:33768 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1904494784_1 at /127.0.0.1:60886 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (337744187) connection to jenkins-hbase4.apache.org/172.31.14.131:40487 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x407c7a8e-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1346150702_17 at /127.0.0.1:60916 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1904494784_1 at /127.0.0.1:33732 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=905 (was 895) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=687 (was 505) - SystemLoadAverage LEAK? -, ProcessCount=179 (was 179), AvailableMemoryMB=4503 (was 5176) 2023-07-12 22:15:15,295 WARN [Listener at jenkins-hbase4.apache.org/41531] hbase.ResourceChecker(130): Thread=758 is superior to 500 2023-07-12 22:15:15,330 INFO [Listener at jenkins-hbase4.apache.org/41531] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=758, OpenFileDescriptor=905, MaxFileDescriptor=60000, SystemLoadAverage=687, ProcessCount=179, AvailableMemoryMB=4494 2023-07-12 22:15:15,331 WARN [Listener at jenkins-hbase4.apache.org/41531] hbase.ResourceChecker(130): Thread=758 is superior to 500 2023-07-12 22:15:15,332 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-12 22:15:15,333 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] procedure2.ProcedureExecutor(1029): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-12 22:15:15,336 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 22:15:15,336 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-07-12 22:15:15,336 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 22:15:15,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-12 22:15:15,339 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testEmptyExportFileSystemState/a151a7e3b7d5ed6911efa8fe5e530b32 2023-07-12 22:15:15,339 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testEmptyExportFileSystemState/9ec6e68e360406b500e11aa98c75f58a 2023-07-12 22:15:15,339 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testEmptyExportFileSystemState/9ec6e68e360406b500e11aa98c75f58a empty. 2023-07-12 22:15:15,339 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testEmptyExportFileSystemState/a151a7e3b7d5ed6911efa8fe5e530b32 empty. 2023-07-12 22:15:15,341 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testEmptyExportFileSystemState/9ec6e68e360406b500e11aa98c75f58a 2023-07-12 22:15:15,341 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testEmptyExportFileSystemState/a151a7e3b7d5ed6911efa8fe5e530b32 2023-07-12 22:15:15,341 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-12 22:15:15,381 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-12 22:15:15,390 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => a151a7e3b7d5ed6911efa8fe5e530b32, NAME => 'testtb-testEmptyExportFileSystemState,,1689200115332.a151a7e3b7d5ed6911efa8fe5e530b32.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp 2023-07-12 22:15:15,403 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 9ec6e68e360406b500e11aa98c75f58a, NAME => 'testtb-testEmptyExportFileSystemState,1,1689200115332.9ec6e68e360406b500e11aa98c75f58a.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp 2023-07-12 22:15:15,443 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-12 22:15:15,463 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689200115332.9ec6e68e360406b500e11aa98c75f58a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 22:15:15,463 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 9ec6e68e360406b500e11aa98c75f58a, disabling compactions & flushes 2023-07-12 22:15:15,463 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689200115332.9ec6e68e360406b500e11aa98c75f58a. 2023-07-12 22:15:15,463 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689200115332.9ec6e68e360406b500e11aa98c75f58a. 2023-07-12 22:15:15,463 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689200115332.9ec6e68e360406b500e11aa98c75f58a. after waiting 0 ms 2023-07-12 22:15:15,463 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689200115332.9ec6e68e360406b500e11aa98c75f58a. 2023-07-12 22:15:15,463 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689200115332.9ec6e68e360406b500e11aa98c75f58a. 2023-07-12 22:15:15,463 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 9ec6e68e360406b500e11aa98c75f58a: 2023-07-12 22:15:15,471 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689200115332.a151a7e3b7d5ed6911efa8fe5e530b32.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 22:15:15,472 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing a151a7e3b7d5ed6911efa8fe5e530b32, disabling compactions & flushes 2023-07-12 22:15:15,472 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689200115332.a151a7e3b7d5ed6911efa8fe5e530b32. 2023-07-12 22:15:15,472 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689200115332.a151a7e3b7d5ed6911efa8fe5e530b32. 2023-07-12 22:15:15,472 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689200115332.a151a7e3b7d5ed6911efa8fe5e530b32. after waiting 0 ms 2023-07-12 22:15:15,472 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689200115332.a151a7e3b7d5ed6911efa8fe5e530b32. 2023-07-12 22:15:15,472 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689200115332.a151a7e3b7d5ed6911efa8fe5e530b32. 2023-07-12 22:15:15,472 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for a151a7e3b7d5ed6911efa8fe5e530b32: 2023-07-12 22:15:15,474 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 22:15:15,476 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689200115332.9ec6e68e360406b500e11aa98c75f58a.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689200115476"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689200115476"}]},"ts":"1689200115476"} 2023-07-12 22:15:15,476 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689200115332.a151a7e3b7d5ed6911efa8fe5e530b32.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689200115476"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689200115476"}]},"ts":"1689200115476"} 2023-07-12 22:15:15,479 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-12 22:15:15,480 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 22:15:15,480 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689200115480"}]},"ts":"1689200115480"} 2023-07-12 22:15:15,482 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-07-12 22:15:15,485 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-12 22:15:15,487 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 22:15:15,487 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 22:15:15,487 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-12 22:15:15,487 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 22:15:15,487 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=a151a7e3b7d5ed6911efa8fe5e530b32, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=9ec6e68e360406b500e11aa98c75f58a, ASSIGN}] 2023-07-12 22:15:15,491 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=9ec6e68e360406b500e11aa98c75f58a, ASSIGN 2023-07-12 22:15:15,491 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=a151a7e3b7d5ed6911efa8fe5e530b32, ASSIGN 2023-07-12 22:15:15,492 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=9ec6e68e360406b500e11aa98c75f58a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40411,1689200016125; forceNewPlan=false, retain=false 2023-07-12 22:15:15,492 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=a151a7e3b7d5ed6911efa8fe5e530b32, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34497,1689200016186; forceNewPlan=false, retain=false 2023-07-12 22:15:15,642 INFO [jenkins-hbase4:43225] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-12 22:15:15,646 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=a151a7e3b7d5ed6911efa8fe5e530b32, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:15:15,646 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=9ec6e68e360406b500e11aa98c75f58a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:15:15,646 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689200115332.a151a7e3b7d5ed6911efa8fe5e530b32.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689200115646"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689200115646"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689200115646"}]},"ts":"1689200115646"} 2023-07-12 22:15:15,647 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689200115332.9ec6e68e360406b500e11aa98c75f58a.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689200115646"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689200115646"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689200115646"}]},"ts":"1689200115646"} 2023-07-12 22:15:15,648 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-12 22:15:15,649 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=91, state=RUNNABLE; OpenRegionProcedure a151a7e3b7d5ed6911efa8fe5e530b32, server=jenkins-hbase4.apache.org,34497,1689200016186}] 2023-07-12 22:15:15,650 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=92, state=RUNNABLE; OpenRegionProcedure 9ec6e68e360406b500e11aa98c75f58a, server=jenkins-hbase4.apache.org,40411,1689200016125}] 2023-07-12 22:15:15,806 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1689200115332.a151a7e3b7d5ed6911efa8fe5e530b32. 2023-07-12 22:15:15,807 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a151a7e3b7d5ed6911efa8fe5e530b32, NAME => 'testtb-testEmptyExportFileSystemState,,1689200115332.a151a7e3b7d5ed6911efa8fe5e530b32.', STARTKEY => '', ENDKEY => '1'} 2023-07-12 22:15:15,807 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1689200115332.a151a7e3b7d5ed6911efa8fe5e530b32. service=AccessControlService 2023-07-12 22:15:15,807 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 22:15:15,807 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState a151a7e3b7d5ed6911efa8fe5e530b32 2023-07-12 22:15:15,807 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689200115332.a151a7e3b7d5ed6911efa8fe5e530b32.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 22:15:15,808 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for a151a7e3b7d5ed6911efa8fe5e530b32 2023-07-12 22:15:15,808 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for a151a7e3b7d5ed6911efa8fe5e530b32 2023-07-12 22:15:15,808 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1689200115332.9ec6e68e360406b500e11aa98c75f58a. 2023-07-12 22:15:15,808 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9ec6e68e360406b500e11aa98c75f58a, NAME => 'testtb-testEmptyExportFileSystemState,1,1689200115332.9ec6e68e360406b500e11aa98c75f58a.', STARTKEY => '1', ENDKEY => ''} 2023-07-12 22:15:15,808 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1689200115332.9ec6e68e360406b500e11aa98c75f58a. service=AccessControlService 2023-07-12 22:15:15,808 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 22:15:15,809 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 9ec6e68e360406b500e11aa98c75f58a 2023-07-12 22:15:15,809 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689200115332.9ec6e68e360406b500e11aa98c75f58a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 22:15:15,809 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 9ec6e68e360406b500e11aa98c75f58a 2023-07-12 22:15:15,809 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 9ec6e68e360406b500e11aa98c75f58a 2023-07-12 22:15:15,811 INFO [StoreOpener-a151a7e3b7d5ed6911efa8fe5e530b32-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region a151a7e3b7d5ed6911efa8fe5e530b32 2023-07-12 22:15:15,812 INFO [StoreOpener-9ec6e68e360406b500e11aa98c75f58a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 9ec6e68e360406b500e11aa98c75f58a 2023-07-12 22:15:15,813 DEBUG [StoreOpener-a151a7e3b7d5ed6911efa8fe5e530b32-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testEmptyExportFileSystemState/a151a7e3b7d5ed6911efa8fe5e530b32/cf 2023-07-12 22:15:15,813 DEBUG [StoreOpener-a151a7e3b7d5ed6911efa8fe5e530b32-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testEmptyExportFileSystemState/a151a7e3b7d5ed6911efa8fe5e530b32/cf 2023-07-12 22:15:15,814 INFO [StoreOpener-a151a7e3b7d5ed6911efa8fe5e530b32-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a151a7e3b7d5ed6911efa8fe5e530b32 columnFamilyName cf 2023-07-12 22:15:15,815 DEBUG [StoreOpener-9ec6e68e360406b500e11aa98c75f58a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testEmptyExportFileSystemState/9ec6e68e360406b500e11aa98c75f58a/cf 2023-07-12 22:15:15,815 DEBUG [StoreOpener-9ec6e68e360406b500e11aa98c75f58a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testEmptyExportFileSystemState/9ec6e68e360406b500e11aa98c75f58a/cf 2023-07-12 22:15:15,816 INFO [StoreOpener-9ec6e68e360406b500e11aa98c75f58a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9ec6e68e360406b500e11aa98c75f58a columnFamilyName cf 2023-07-12 22:15:15,818 INFO [StoreOpener-9ec6e68e360406b500e11aa98c75f58a-1] regionserver.HStore(310): Store=9ec6e68e360406b500e11aa98c75f58a/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 22:15:15,819 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testEmptyExportFileSystemState/9ec6e68e360406b500e11aa98c75f58a 2023-07-12 22:15:15,820 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testEmptyExportFileSystemState/9ec6e68e360406b500e11aa98c75f58a 2023-07-12 22:15:15,822 INFO [StoreOpener-a151a7e3b7d5ed6911efa8fe5e530b32-1] regionserver.HStore(310): Store=a151a7e3b7d5ed6911efa8fe5e530b32/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 22:15:15,823 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 9ec6e68e360406b500e11aa98c75f58a 2023-07-12 22:15:15,824 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testEmptyExportFileSystemState/a151a7e3b7d5ed6911efa8fe5e530b32 2023-07-12 22:15:15,824 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testEmptyExportFileSystemState/a151a7e3b7d5ed6911efa8fe5e530b32 2023-07-12 22:15:15,827 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testEmptyExportFileSystemState/9ec6e68e360406b500e11aa98c75f58a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 22:15:15,828 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for a151a7e3b7d5ed6911efa8fe5e530b32 2023-07-12 22:15:15,828 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 9ec6e68e360406b500e11aa98c75f58a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60604674, jitterRate=-0.09691998362541199}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 22:15:15,828 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 9ec6e68e360406b500e11aa98c75f58a: 2023-07-12 22:15:15,830 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1689200115332.9ec6e68e360406b500e11aa98c75f58a., pid=94, masterSystemTime=1689200115802 2023-07-12 22:15:15,831 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1689200115332.9ec6e68e360406b500e11aa98c75f58a. 2023-07-12 22:15:15,831 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1689200115332.9ec6e68e360406b500e11aa98c75f58a. 2023-07-12 22:15:15,832 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=9ec6e68e360406b500e11aa98c75f58a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:15:15,832 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1689200115332.9ec6e68e360406b500e11aa98c75f58a.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689200115832"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689200115832"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689200115832"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689200115832"}]},"ts":"1689200115832"} 2023-07-12 22:15:15,836 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testEmptyExportFileSystemState/a151a7e3b7d5ed6911efa8fe5e530b32/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 22:15:15,837 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened a151a7e3b7d5ed6911efa8fe5e530b32; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72763965, jitterRate=0.08426757156848907}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 22:15:15,837 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for a151a7e3b7d5ed6911efa8fe5e530b32: 2023-07-12 22:15:15,839 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1689200115332.a151a7e3b7d5ed6911efa8fe5e530b32., pid=93, masterSystemTime=1689200115801 2023-07-12 22:15:15,840 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=92 2023-07-12 22:15:15,840 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=92, state=SUCCESS; OpenRegionProcedure 9ec6e68e360406b500e11aa98c75f58a, server=jenkins-hbase4.apache.org,40411,1689200016125 in 186 msec 2023-07-12 22:15:15,840 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1689200115332.a151a7e3b7d5ed6911efa8fe5e530b32. 2023-07-12 22:15:15,841 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1689200115332.a151a7e3b7d5ed6911efa8fe5e530b32. 2023-07-12 22:15:15,841 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=a151a7e3b7d5ed6911efa8fe5e530b32, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:15:15,841 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1689200115332.a151a7e3b7d5ed6911efa8fe5e530b32.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689200115841"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689200115841"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689200115841"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689200115841"}]},"ts":"1689200115841"} 2023-07-12 22:15:15,850 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=9ec6e68e360406b500e11aa98c75f58a, ASSIGN in 353 msec 2023-07-12 22:15:15,851 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=91 2023-07-12 22:15:15,852 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=91, state=SUCCESS; OpenRegionProcedure a151a7e3b7d5ed6911efa8fe5e530b32, server=jenkins-hbase4.apache.org,34497,1689200016186 in 194 msec 2023-07-12 22:15:15,853 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=91, resume processing ppid=90 2023-07-12 22:15:15,853 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=a151a7e3b7d5ed6911efa8fe5e530b32, ASSIGN in 365 msec 2023-07-12 22:15:15,855 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 22:15:15,855 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689200115855"}]},"ts":"1689200115855"} 2023-07-12 22:15:15,856 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-07-12 22:15:15,860 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 22:15:15,860 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-07-12 22:15:15,864 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34497] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-12 22:15:15,866 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 22:15:15,866 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 22:15:15,866 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 22:15:15,867 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 22:15:15,870 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-12 22:15:15,870 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-12 22:15:15,870 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-12 22:15:15,870 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-12 22:15:15,872 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 537 msec 2023-07-12 22:15:15,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-12 22:15:15,950 INFO [Listener at jenkins-hbase4.apache.org/41531] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-07-12 22:15:15,967 DEBUG [Listener at jenkins-hbase4.apache.org/41531] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-12 22:15:15,967 DEBUG [Listener at jenkins-hbase4.apache.org/41531] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1689200115332.a151a7e3b7d5ed6911efa8fe5e530b32. 2023-07-12 22:15:15,970 INFO [Listener at jenkins-hbase4.apache.org/41531] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 22:15:16,005 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 22:15:16,006 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689200116006 (current time:1689200116006). 2023-07-12 22:15:16,006 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 22:15:16,006 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] zookeeper.ReadOnlyZKClient(139): Connect 0x4044d2b7 to 127.0.0.1:62393 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 22:15:16,023 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3c1ffc97, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 22:15:16,028 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 22:15:16,030 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34656, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 22:15:16,031 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4044d2b7 to 127.0.0.1:62393 2023-07-12 22:15:16,031 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 22:15:16,032 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] zookeeper.ReadOnlyZKClient(139): Connect 0x11cb5c72 to 127.0.0.1:62393 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 22:15:16,057 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@777ce596, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 22:15:16,067 DEBUG [hconnection-0x344454aa-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 22:15:16,071 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34666, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 22:15:16,077 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 22:15:16,078 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:32782, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 22:15:16,079 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x11cb5c72 to 127.0.0.1:62393 2023-07-12 22:15:16,080 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 22:15:16,080 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-12 22:15:16,081 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 22:15:16,081 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 22:15:16,083 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-12 22:15:16,085 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-12 22:15:16,086 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689200716086 2023-07-12 22:15:16,086 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-12 22:15:16,086 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 22:15:16,088 DEBUG [Listener at jenkins-hbase4.apache.org/41531] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 22:15:16,088 DEBUG [Listener at jenkins-hbase4.apache.org/41531] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 22:15:16,091 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-12 22:15:16,092 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-12 22:15:16,095 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 10 msec 2023-07-12 22:15:16,098 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-12 22:15:16,102 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689200716102 2023-07-12 22:15:16,140 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:16,140 INFO [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-07-12 22:15:16,140 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 22:15:16,141 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-12 22:15:16,141 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-12 22:15:16,142 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:16,142 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:16,153 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:15:16,153 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:15:16,153 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:15:16,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:15:16,153 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:15:16,153 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:15:16,154 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:15:16,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:15:16,154 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:15:16,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:15:16,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:16,154 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:15:16,154 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:15:16,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:16,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:16,159 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:15:16,159 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 22:15:16,159 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:16,159 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:16,159 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:16,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-12 22:15:16,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:16,160 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-12 22:15:16,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-12 22:15:16,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:16,160 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-12 22:15:16,160 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:16,160 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-12 22:15:16,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-12 22:15:16,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:16,160 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 22:15:16,161 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-12 22:15:16,178 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:16,181 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-12 22:15:16,181 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:16,180 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-12 22:15:16,181 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-12 22:15:16,181 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-12 22:15:16,182 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 22:15:16,181 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 22:15:16,183 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-12 22:15:16,184 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-12 22:15:16,182 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40411,1689200016125' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-12 22:15:16,185 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-12 22:15:16,185 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-12 22:15:16,185 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34497,1689200016186' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-12 22:15:16,184 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37349,1689200016037' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-12 22:15:16,188 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:15:16,188 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:16,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:15:16,188 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:16,188 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:16,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 22:15:16,188 DEBUG [Listener at jenkins-hbase4.apache.org/41531] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 22:15:16,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 22:15:16,188 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:15:16,189 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:16,189 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:16,189 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 22:15:16,189 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 22:15:16,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 22:15:16,189 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:16,189 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 22:15:16,189 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-12 22:15:16,189 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-12 22:15:16,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 22:15:16,190 DEBUG [Listener at jenkins-hbase4.apache.org/41531] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 22:15:16,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:16,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:15:16,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:15:16,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:15:16,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 22:15:16,208 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40411,1689200016125' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-12 22:15:16,208 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5b345f82[Count = 1] remaining members to acquire global barrier 2023-07-12 22:15:16,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:15:16,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 22:15:16,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 22:15:16,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 22:15:16,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 22:15:16,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:16,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:15:16,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:15:16,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:15:16,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 22:15:16,211 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34497,1689200016186' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-12 22:15:16,211 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5b345f82[Count = 0] remaining members to acquire global barrier 2023-07-12 22:15:16,211 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-12 22:15:16,211 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:16,213 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:16,213 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:16,213 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:16,213 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:16,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:16,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:16,213 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-12 22:15:16,213 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-12 22:15:16,213 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:15:16,213 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 22:15:16,213 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 22:15:16,213 DEBUG [rs(jenkins-hbase4.apache.org,40411,1689200016125)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689200115332.9ec6e68e360406b500e11aa98c75f58a. 2023-07-12 22:15:16,214 DEBUG [rs(jenkins-hbase4.apache.org,40411,1689200016125)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689200115332.9ec6e68e360406b500e11aa98c75f58a. started... 2023-07-12 22:15:16,214 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:15:16,214 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 22:15:16,215 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:16,215 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:16,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:16,215 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-12 22:15:16,215 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-12 22:15:16,215 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,37349,1689200016037' in zk 2023-07-12 22:15:16,217 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 22:15:16,217 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 22:15:16,220 DEBUG [rs(jenkins-hbase4.apache.org,40411,1689200016125)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9ec6e68e360406b500e11aa98c75f58a: 2023-07-12 22:15:16,220 DEBUG [rs(jenkins-hbase4.apache.org,40411,1689200016125)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689200115332.9ec6e68e360406b500e11aa98c75f58a.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:16,220 DEBUG [rs(jenkins-hbase4.apache.org,40411,1689200016125)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 22:15:16,220 DEBUG [rs(jenkins-hbase4.apache.org,40411,1689200016125)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 22:15:16,234 DEBUG [rs(jenkins-hbase4.apache.org,34497,1689200016186)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689200115332.a151a7e3b7d5ed6911efa8fe5e530b32. 2023-07-12 22:15:16,237 DEBUG [rs(jenkins-hbase4.apache.org,34497,1689200016186)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689200115332.a151a7e3b7d5ed6911efa8fe5e530b32. started... 2023-07-12 22:15:16,237 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-12 22:15:16,237 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 22:15:16,237 DEBUG [rs(jenkins-hbase4.apache.org,34497,1689200016186)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a151a7e3b7d5ed6911efa8fe5e530b32: 2023-07-12 22:15:16,237 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-12 22:15:16,241 DEBUG [rs(jenkins-hbase4.apache.org,34497,1689200016186)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689200115332.a151a7e3b7d5ed6911efa8fe5e530b32.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:16,241 DEBUG [rs(jenkins-hbase4.apache.org,34497,1689200016186)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 22:15:16,241 DEBUG [rs(jenkins-hbase4.apache.org,34497,1689200016186)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 22:15:16,284 DEBUG [rs(jenkins-hbase4.apache.org,40411,1689200016125)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689200115332.9ec6e68e360406b500e11aa98c75f58a. completed. 2023-07-12 22:15:16,284 DEBUG [rs(jenkins-hbase4.apache.org,40411,1689200016125)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689200115332.9ec6e68e360406b500e11aa98c75f58a. 2023-07-12 22:15:16,284 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 22:15:16,284 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 22:15:16,284 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:15:16,284 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-12 22:15:16,284 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40411,1689200016125' in zk 2023-07-12 22:15:16,287 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:15:16,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:15:16,287 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-12 22:15:16,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 22:15:16,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 22:15:16,287 DEBUG [rs(jenkins-hbase4.apache.org,34497,1689200016186)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689200115332.a151a7e3b7d5ed6911efa8fe5e530b32. completed. 2023-07-12 22:15:16,287 DEBUG [rs(jenkins-hbase4.apache.org,34497,1689200016186)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689200115332.a151a7e3b7d5ed6911efa8fe5e530b32. 2023-07-12 22:15:16,287 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 22:15:16,288 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 22:15:16,288 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:15:16,287 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 22:15:16,288 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-12 22:15:16,288 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-12 22:15:16,288 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,34497,1689200016186' in zk 2023-07-12 22:15:16,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 22:15:16,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 22:15:16,292 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:15:16,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:16,292 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-12 22:15:16,292 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 22:15:16,292 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-12 22:15:16,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:15:16,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:15:16,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:15:16,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 22:15:16,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:16,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:15:16,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:15:16,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:15:16,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,40411,1689200016125': 2023-07-12 22:15:16,297 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40411,1689200016125' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-12 22:15:16,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:15:16,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 22:15:16,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 22:15:16,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 22:15:16,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 22:15:16,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:16,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:15:16,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:15:16,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:15:16,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 22:15:16,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:16,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:15:16,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:15:16,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:15:16,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,34497,1689200016186': 2023-07-12 22:15:16,304 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34497,1689200016186' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-12 22:15:16,304 INFO [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-07-12 22:15:16,304 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 22:15:16,304 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 22:15:16,304 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:16,304 INFO [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 22:15:16,307 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:16,307 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:16,307 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:16,307 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:16,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:16,307 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:16,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:16,307 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:15:16,307 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:15:16,307 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:16,307 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:15:16,307 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:16,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:16,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 22:15:16,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 22:15:16,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:16,308 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:15:16,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:15:16,308 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:15:16,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:15:16,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:16,308 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:15:16,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:15:16,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 22:15:16,308 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:15:16,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:16,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:16,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:16,311 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:15:16,311 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:15:16,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 22:15:16,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:16,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:15:16,313 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:15:16,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:15:16,314 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:15:16,314 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:15:16,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:15:16,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 22:15:16,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:16,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:15:16,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:15:16,319 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:15:16,319 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:15:16,319 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:15:16,319 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:15:16,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:15:16,319 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 22:15:16,319 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:15:16,319 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:16,323 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-07-12 22:15:16,319 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:16,323 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:15:16,323 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:15:16,323 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:16,323 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:15:16,323 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:16,323 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:15:16,323 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:15:16,323 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:16,323 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:16,319 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:15:16,323 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:15:16,323 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:16,323 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-12 22:15:16,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:15:16,322 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:15:16,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:15:16,322 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:15:16,323 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:15:16,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:15:16,324 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-12 22:15:16,324 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:15:16,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:15:16,324 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:15:16,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:15:16,325 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState because node does not exist (not an error) 2023-07-12 22:15:16,330 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:15:16,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:15:16,353 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:16,356 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:16,390 DEBUG [Listener at jenkins-hbase4.apache.org/41531] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 22:15:16,391 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-12 22:15:16,391 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-12 22:15:16,392 DEBUG [Listener at jenkins-hbase4.apache.org/41531] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-12 22:15:16,413 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:16,452 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-12 22:15:16,452 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:16,452 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:16,452 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689200116086Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1689200116353 (+267 ms)Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689200116353Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1689200116354 (+1 ms)Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1689200116372 (+18 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689200116390 (+18 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689200116452 (+62 ms) 2023-07-12 22:15:16,457 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-12 22:15:16,458 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 369 msec 2023-07-12 22:15:16,692 DEBUG [Listener at jenkins-hbase4.apache.org/41531] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 22:15:16,693 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-12 22:15:16,693 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 22:15:16,695 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34497] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1689200115332.a151a7e3b7d5ed6911efa8fe5e530b32. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 22:15:16,696 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40411] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1689200115332.9ec6e68e360406b500e11aa98c75f58a. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 22:15:16,700 DEBUG [Listener at jenkins-hbase4.apache.org/41531] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-12 22:15:16,700 DEBUG [Listener at jenkins-hbase4.apache.org/41531] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1689200115332.a151a7e3b7d5ed6911efa8fe5e530b32. 2023-07-12 22:15:16,700 INFO [Listener at jenkins-hbase4.apache.org/41531] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 22:15:16,709 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 22:15:16,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689200116710 (current time:1689200116710). 2023-07-12 22:15:16,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 22:15:16,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] zookeeper.ReadOnlyZKClient(139): Connect 0x752d6af4 to 127.0.0.1:62393 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 22:15:16,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@635a91ff, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 22:15:16,719 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 22:15:16,721 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34672, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 22:15:16,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x752d6af4 to 127.0.0.1:62393 2023-07-12 22:15:16,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 22:15:16,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] zookeeper.ReadOnlyZKClient(139): Connect 0x37666b51 to 127.0.0.1:62393 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 22:15:16,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2982dd83, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 22:15:16,796 DEBUG [hconnection-0x1ee07425-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 22:15:16,798 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34684, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 22:15:16,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 22:15:16,812 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:32798, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 22:15:16,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x37666b51 to 127.0.0.1:62393 2023-07-12 22:15:16,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 22:15:16,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-12 22:15:16,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 22:15:16,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 22:15:16,816 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-12 22:15:16,817 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-12 22:15:16,818 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689200716818 2023-07-12 22:15:16,818 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-12 22:15:16,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 22:15:16,820 DEBUG [Listener at jenkins-hbase4.apache.org/41531] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 22:15:16,820 DEBUG [Listener at jenkins-hbase4.apache.org/41531] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 22:15:16,821 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-12 22:15:16,821 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-12 22:15:16,822 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-07-12 22:15:16,823 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-12 22:15:16,826 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689200716826 2023-07-12 22:15:16,839 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:16,839 INFO [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-07-12 22:15:16,839 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 22:15:16,841 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-12 22:15:16,841 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-12 22:15:16,863 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:16,863 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:16,921 DEBUG [Listener at jenkins-hbase4.apache.org/41531] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 22:15:16,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-12 22:15:16,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-12 22:15:16,922 DEBUG [Listener at jenkins-hbase4.apache.org/41531] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 22:15:16,932 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:15:16,933 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:15:16,933 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:15:16,932 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:15:16,932 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:15:16,933 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:15:16,933 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:15:16,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:15:16,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:15:16,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:15:16,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:16,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:16,934 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:16,934 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:16,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-12 22:15:16,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:16,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-12 22:15:16,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:16,934 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-12 22:15:16,934 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-12 22:15:16,935 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:16,935 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:16,935 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-12 22:15:16,935 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-12 22:15:16,935 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 22:15:16,935 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 22:15:16,936 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-12 22:15:16,937 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-12 22:15:16,938 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34497,1689200016186' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-12 22:15:16,938 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-12 22:15:16,939 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-12 22:15:16,939 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37349,1689200016037' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-12 22:15:16,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:16,940 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:15:16,940 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:15:16,941 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,002 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,002 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:15:17,002 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 22:15:17,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-12 22:15:17,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,002 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,002 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:15:17,002 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-12 22:15:17,002 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,003 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 22:15:17,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:15:17,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 22:15:17,003 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 22:15:17,003 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,003 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 22:15:17,003 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-12 22:15:17,003 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 22:15:17,008 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-12 22:15:17,008 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-12 22:15:17,008 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40411,1689200016125' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-12 22:15:17,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 22:15:17,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 22:15:17,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,033 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:15:17,033 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:15:17,033 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,033 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 22:15:17,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:15:17,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:15:17,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 22:15:17,035 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34497,1689200016186' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-12 22:15:17,035 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@41f953cc[Count = 1] remaining members to acquire global barrier 2023-07-12 22:15:17,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:15:17,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 22:15:17,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 22:15:17,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 22:15:17,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 22:15:17,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:15:17,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:15:17,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:15:17,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 22:15:17,048 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40411,1689200016125' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-12 22:15:17,048 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@41f953cc[Count = 0] remaining members to acquire global barrier 2023-07-12 22:15:17,048 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-12 22:15:17,049 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,074 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,074 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,074 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,075 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-12 22:15:17,074 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,075 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-12 22:15:17,075 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-12 22:15:17,075 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,37349,1689200016037' in zk 2023-07-12 22:15:17,075 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 22:15:17,075 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 22:15:17,075 DEBUG [rs(jenkins-hbase4.apache.org,34497,1689200016186)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689200115332.a151a7e3b7d5ed6911efa8fe5e530b32. 2023-07-12 22:15:17,075 DEBUG [rs(jenkins-hbase4.apache.org,34497,1689200016186)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689200115332.a151a7e3b7d5ed6911efa8fe5e530b32. started... 2023-07-12 22:15:17,075 INFO [rs(jenkins-hbase4.apache.org,34497,1689200016186)-snapshot-pool-0] regionserver.HRegion(2745): Flushing a151a7e3b7d5ed6911efa8fe5e530b32 1/1 column families, dataSize=333 B heapSize=976 B 2023-07-12 22:15:17,079 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,079 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,079 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-12 22:15:17,083 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 22:15:17,083 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 22:15:17,083 DEBUG [rs(jenkins-hbase4.apache.org,40411,1689200016125)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689200115332.9ec6e68e360406b500e11aa98c75f58a. 2023-07-12 22:15:17,083 DEBUG [rs(jenkins-hbase4.apache.org,40411,1689200016125)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689200115332.9ec6e68e360406b500e11aa98c75f58a. started... 2023-07-12 22:15:17,084 INFO [rs(jenkins-hbase4.apache.org,40411,1689200016125)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 9ec6e68e360406b500e11aa98c75f58a 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-07-12 22:15:17,102 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-12 22:15:17,102 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:15:17,102 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 22:15:17,102 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-12 22:15:17,104 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:15:17,104 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 22:15:17,122 DEBUG [Listener at jenkins-hbase4.apache.org/41531] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 22:15:17,123 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-12 22:15:17,124 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-12 22:15:17,124 DEBUG [Listener at jenkins-hbase4.apache.org/41531] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-12 22:15:17,160 INFO [rs(jenkins-hbase4.apache.org,34497,1689200016186)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230712a1ccefc52d3446739648074921372ca3 to hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230712a1ccefc52d3446739648074921372ca3 2023-07-12 22:15:17,182 INFO [rs(jenkins-hbase4.apache.org,40411,1689200016125)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023071223f5b933190048ce8f7c718dcc766db7 to hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b2023071223f5b933190048ce8f7c718dcc766db7 2023-07-12 22:15:17,199 INFO [rs(jenkins-hbase4.apache.org,34497,1689200016186)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testEmptyExportFileSystemState/a151a7e3b7d5ed6911efa8fe5e530b32/.tmp/cf/18055cbf13494a23bbde5de5ef16ef51 2023-07-12 22:15:17,214 DEBUG [rs(jenkins-hbase4.apache.org,34497,1689200016186)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testEmptyExportFileSystemState/a151a7e3b7d5ed6911efa8fe5e530b32/.tmp/cf/18055cbf13494a23bbde5de5ef16ef51 as hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testEmptyExportFileSystemState/a151a7e3b7d5ed6911efa8fe5e530b32/cf/18055cbf13494a23bbde5de5ef16ef51 2023-07-12 22:15:17,215 INFO [rs(jenkins-hbase4.apache.org,40411,1689200016125)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testEmptyExportFileSystemState/9ec6e68e360406b500e11aa98c75f58a/.tmp/cf/8b972878d0684d1ea70279760ed1c98d 2023-07-12 22:15:17,221 INFO [rs(jenkins-hbase4.apache.org,34497,1689200016186)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testEmptyExportFileSystemState/a151a7e3b7d5ed6911efa8fe5e530b32/cf/18055cbf13494a23bbde5de5ef16ef51, entries=5, sequenceid=6, filesize=5.8 K 2023-07-12 22:15:17,222 INFO [rs(jenkins-hbase4.apache.org,34497,1689200016186)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for a151a7e3b7d5ed6911efa8fe5e530b32 in 147ms, sequenceid=6, compaction requested=false 2023-07-12 22:15:17,222 DEBUG [rs(jenkins-hbase4.apache.org,34497,1689200016186)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-07-12 22:15:17,222 DEBUG [rs(jenkins-hbase4.apache.org,34497,1689200016186)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a151a7e3b7d5ed6911efa8fe5e530b32: 2023-07-12 22:15:17,223 DEBUG [rs(jenkins-hbase4.apache.org,34497,1689200016186)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689200115332.a151a7e3b7d5ed6911efa8fe5e530b32.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,223 DEBUG [rs(jenkins-hbase4.apache.org,34497,1689200016186)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 22:15:17,223 DEBUG [rs(jenkins-hbase4.apache.org,40411,1689200016125)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testEmptyExportFileSystemState/9ec6e68e360406b500e11aa98c75f58a/.tmp/cf/8b972878d0684d1ea70279760ed1c98d as hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testEmptyExportFileSystemState/9ec6e68e360406b500e11aa98c75f58a/cf/8b972878d0684d1ea70279760ed1c98d 2023-07-12 22:15:17,223 DEBUG [rs(jenkins-hbase4.apache.org,34497,1689200016186)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testEmptyExportFileSystemState/a151a7e3b7d5ed6911efa8fe5e530b32/cf/18055cbf13494a23bbde5de5ef16ef51] hfiles 2023-07-12 22:15:17,223 DEBUG [rs(jenkins-hbase4.apache.org,34497,1689200016186)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testEmptyExportFileSystemState/a151a7e3b7d5ed6911efa8fe5e530b32/cf/18055cbf13494a23bbde5de5ef16ef51 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,229 INFO [rs(jenkins-hbase4.apache.org,40411,1689200016125)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testEmptyExportFileSystemState/9ec6e68e360406b500e11aa98c75f58a/cf/8b972878d0684d1ea70279760ed1c98d, entries=45, sequenceid=6, filesize=12.7 K 2023-07-12 22:15:17,230 INFO [rs(jenkins-hbase4.apache.org,40411,1689200016125)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for 9ec6e68e360406b500e11aa98c75f58a in 146ms, sequenceid=6, compaction requested=false 2023-07-12 22:15:17,232 DEBUG [rs(jenkins-hbase4.apache.org,40411,1689200016125)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9ec6e68e360406b500e11aa98c75f58a: 2023-07-12 22:15:17,232 DEBUG [rs(jenkins-hbase4.apache.org,40411,1689200016125)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689200115332.9ec6e68e360406b500e11aa98c75f58a.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,233 DEBUG [rs(jenkins-hbase4.apache.org,40411,1689200016125)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 22:15:17,234 DEBUG [rs(jenkins-hbase4.apache.org,40411,1689200016125)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testEmptyExportFileSystemState/9ec6e68e360406b500e11aa98c75f58a/cf/8b972878d0684d1ea70279760ed1c98d] hfiles 2023-07-12 22:15:17,234 DEBUG [rs(jenkins-hbase4.apache.org,40411,1689200016125)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testEmptyExportFileSystemState/9ec6e68e360406b500e11aa98c75f58a/cf/8b972878d0684d1ea70279760ed1c98d for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,263 DEBUG [rs(jenkins-hbase4.apache.org,34497,1689200016186)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689200115332.a151a7e3b7d5ed6911efa8fe5e530b32. completed. 2023-07-12 22:15:17,263 DEBUG [rs(jenkins-hbase4.apache.org,34497,1689200016186)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689200115332.a151a7e3b7d5ed6911efa8fe5e530b32. 2023-07-12 22:15:17,263 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 22:15:17,263 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 22:15:17,263 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:15:17,263 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-12 22:15:17,263 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,34497,1689200016186' in zk 2023-07-12 22:15:17,271 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:15:17,271 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-12 22:15:17,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:15:17,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 22:15:17,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 22:15:17,271 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 22:15:17,271 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-12 22:15:17,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 22:15:17,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 22:15:17,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:15:17,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:15:17,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:15:17,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 22:15:17,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:15:17,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:15:17,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,34497,1689200016186': 2023-07-12 22:15:17,277 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34497,1689200016186' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-12 22:15:17,424 DEBUG [Listener at jenkins-hbase4.apache.org/41531] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 22:15:17,425 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-12 22:15:17,425 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-12 22:15:17,426 DEBUG [Listener at jenkins-hbase4.apache.org/41531] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-12 22:15:17,670 DEBUG [rs(jenkins-hbase4.apache.org,40411,1689200016125)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689200115332.9ec6e68e360406b500e11aa98c75f58a. completed. 2023-07-12 22:15:17,670 DEBUG [rs(jenkins-hbase4.apache.org,40411,1689200016125)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689200115332.9ec6e68e360406b500e11aa98c75f58a. 2023-07-12 22:15:17,670 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 22:15:17,670 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 22:15:17,670 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:15:17,670 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-12 22:15:17,670 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40411,1689200016125' in zk 2023-07-12 22:15:17,672 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:15:17,672 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-12 22:15:17,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:15:17,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 22:15:17,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 22:15:17,672 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 22:15:17,672 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-12 22:15:17,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 22:15:17,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 22:15:17,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:15:17,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:15:17,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:15:17,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 22:15:17,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:15:17,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:15:17,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:15:17,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,40411,1689200016125': 2023-07-12 22:15:17,679 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40411,1689200016125' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-12 22:15:17,679 INFO [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-07-12 22:15:17,679 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 22:15:17,679 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 22:15:17,679 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,679 INFO [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 22:15:17,681 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,681 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,681 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,681 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,681 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 22:15:17,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 22:15:17,681 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:15:17,681 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,681 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:15:17,681 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,681 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:15:17,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:15:17,681 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:15:17,681 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:15:17,682 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:15:17,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 22:15:17,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:15:17,682 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:15:17,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:15:17,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,682 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:15:17,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,683 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:15:17,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 22:15:17,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:15:17,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:15:17,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:15:17,685 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:15:17,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 22:15:17,685 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:15:17,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,685 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:15:17,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:15:17,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:15:17,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:15:17,690 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:15:17,690 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:15:17,690 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:15:17,690 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:15:17,690 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:15:17,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:15:17,690 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:15:17,691 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,690 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:15:17,691 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-07-12 22:15:17,691 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:15:17,691 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,691 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:15:17,691 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-12 22:15:17,691 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 22:15:17,690 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:15:17,691 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:15:17,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:15:17,691 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,693 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:15:17,693 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:15:17,693 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,693 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:15:17,693 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,693 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:15:17,693 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:15:17,693 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,693 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:15:17,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:15:17,693 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:15:17,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:15:17,694 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b2023071223f5b933190048ce8f7c718dcc766db7, hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230712a1ccefc52d3446739648074921372ca3] mob files 2023-07-12 22:15:17,694 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b2023071223f5b933190048ce8f7c718dcc766db7 2023-07-12 22:15:17,694 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230712a1ccefc52d3446739648074921372ca3 2023-07-12 22:15:17,694 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:15:17,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:15:17,724 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,724 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,768 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,926 DEBUG [Listener at jenkins-hbase4.apache.org/41531] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 22:15:17,927 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-12 22:15:17,927 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-12 22:15:17,927 DEBUG [Listener at jenkins-hbase4.apache.org/41531] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-07-12 22:15:18,220 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-12 22:15:18,220 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:18,220 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:18,220 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689200116818Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1689200117724 (+906 ms)Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1689200117724Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1689200117724Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1689200117731 (+7 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1689200117749 (+18 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689200118220 (+471 ms) 2023-07-12 22:15:18,226 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-12 22:15:18,228 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 1.4070 sec 2023-07-12 22:15:18,915 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689200025069_0005_000001 (auth:SIMPLE) 2023-07-12 22:15:18,927 DEBUG [Listener at jenkins-hbase4.apache.org/41531] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 22:15:18,928 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-12 22:15:18,928 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 22:15:18,929 INFO [Listener at jenkins-hbase4.apache.org/41531] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/export-test/export-1689200118929 2023-07-12 22:15:18,929 INFO [Listener at jenkins-hbase4.apache.org/41531] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:34335, tgtDir=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/export-test/export-1689200118929, rawTgtDir=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/export-test/export-1689200118929, srcFsUri=hdfs://localhost:34335, srcDir=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967 2023-07-12 22:15:18,964 DEBUG [Listener at jenkins-hbase4.apache.org/41531] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:34335, inputRoot=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967 2023-07-12 22:15:18,964 DEBUG [Listener at jenkins-hbase4.apache.org/41531] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1476150175_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/export-test/export-1689200118929, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/export-test/export-1689200118929/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:18,964 INFO [Listener at jenkins-hbase4.apache.org/41531] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:34335, inputRoot=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967, snapshotDir=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-07-12 22:15:18,984 INFO [Listener at jenkins-hbase4.apache.org/41531] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/export-test/export-1689200118929/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:19,051 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-12 22:15:19,051 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-12 22:15:19,052 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-12 22:15:19,052 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-12 22:15:19,053 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-12 22:15:19,053 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-12 22:15:19,053 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-12 22:15:19,158 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/652e6e64-efb3-f860-57fa-f551f44ecb6b/hadoop-7568082830034527459.jar 2023-07-12 22:15:19,159 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-12 22:15:19,159 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-12 22:15:19,160 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-12 22:15:19,160 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-12 22:15:19,161 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-12 22:15:19,161 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-12 22:15:19,162 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-12 22:15:19,162 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-12 22:15:19,163 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-12 22:15:19,164 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-12 22:15:19,164 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-12 22:15:19,165 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-12 22:15:19,165 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-12 22:15:19,166 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-12 22:15:19,166 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-12 22:15:19,167 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-12 22:15:19,168 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 22:15:19,168 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 22:15:19,169 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 22:15:19,169 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 22:15:19,169 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 22:15:19,170 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 22:15:19,171 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 22:15:20,189 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-12 22:15:20,536 WARN [Listener at jenkins-hbase4.apache.org/41531] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-12 22:15:20,539 INFO [Listener at jenkins-hbase4.apache.org/41531] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-07-12 22:15:20,638 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 22:15:20,638 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 22:15:20,676 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689200025069_0006_000001 (auth:SIMPLE) 2023-07-12 22:15:26,696 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689200025069_0006_000001 (auth:SIMPLE) 2023-07-12 22:15:29,765 INFO [Listener at jenkins-hbase4.apache.org/41531] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-12 22:15:29,767 INFO [Listener at jenkins-hbase4.apache.org/41531] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-12 22:15:29,806 INFO [Listener at jenkins-hbase4.apache.org/41531] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:29,807 INFO [Listener at jenkins-hbase4.apache.org/41531] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-12 22:15:29,807 INFO [Listener at jenkins-hbase4.apache.org/41531] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-12 22:15:29,808 DEBUG [Listener at jenkins-hbase4.apache.org/41531] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1346150702_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:29,808 DEBUG [Listener at jenkins-hbase4.apache.org/41531] snapshot.TestExportSnapshot(367): hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-12 22:15:29,809 DEBUG [Listener at jenkins-hbase4.apache.org/41531] snapshot.TestExportSnapshot(367): hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-12 22:15:29,809 DEBUG [Listener at jenkins-hbase4.apache.org/41531] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1346150702_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/export-test/export-1689200118929/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/export-test/export-1689200118929/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:29,809 DEBUG [Listener at jenkins-hbase4.apache.org/41531] snapshot.TestExportSnapshot(367): hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/export-test/export-1689200118929/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-12 22:15:29,809 DEBUG [Listener at jenkins-hbase4.apache.org/41531] snapshot.TestExportSnapshot(367): hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/export-test/export-1689200118929/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-12 22:15:29,816 INFO [Listener at jenkins-hbase4.apache.org/41531] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-07-12 22:15:29,816 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-07-12 22:15:29,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] procedure2.ProcedureExecutor(1029): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-12 22:15:29,825 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689200129824"}]},"ts":"1689200129824"} 2023-07-12 22:15:29,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-12 22:15:29,826 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-07-12 22:15:29,829 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-07-12 22:15:29,830 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=a151a7e3b7d5ed6911efa8fe5e530b32, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=9ec6e68e360406b500e11aa98c75f58a, UNASSIGN}] 2023-07-12 22:15:29,833 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=a151a7e3b7d5ed6911efa8fe5e530b32, UNASSIGN 2023-07-12 22:15:29,834 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=9ec6e68e360406b500e11aa98c75f58a, UNASSIGN 2023-07-12 22:15:29,835 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=a151a7e3b7d5ed6911efa8fe5e530b32, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:15:29,835 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=9ec6e68e360406b500e11aa98c75f58a, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:15:29,835 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689200115332.a151a7e3b7d5ed6911efa8fe5e530b32.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689200129835"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689200129835"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689200129835"}]},"ts":"1689200129835"} 2023-07-12 22:15:29,835 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689200115332.9ec6e68e360406b500e11aa98c75f58a.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689200129835"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689200129835"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689200129835"}]},"ts":"1689200129835"} 2023-07-12 22:15:29,838 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; CloseRegionProcedure a151a7e3b7d5ed6911efa8fe5e530b32, server=jenkins-hbase4.apache.org,34497,1689200016186}] 2023-07-12 22:15:29,839 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=101, state=RUNNABLE; CloseRegionProcedure 9ec6e68e360406b500e11aa98c75f58a, server=jenkins-hbase4.apache.org,40411,1689200016125}] 2023-07-12 22:15:29,928 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-12 22:15:29,991 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close a151a7e3b7d5ed6911efa8fe5e530b32 2023-07-12 22:15:29,991 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing a151a7e3b7d5ed6911efa8fe5e530b32, disabling compactions & flushes 2023-07-12 22:15:29,991 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689200115332.a151a7e3b7d5ed6911efa8fe5e530b32. 2023-07-12 22:15:29,991 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689200115332.a151a7e3b7d5ed6911efa8fe5e530b32. 2023-07-12 22:15:29,991 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689200115332.a151a7e3b7d5ed6911efa8fe5e530b32. after waiting 0 ms 2023-07-12 22:15:29,991 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689200115332.a151a7e3b7d5ed6911efa8fe5e530b32. 2023-07-12 22:15:29,996 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 9ec6e68e360406b500e11aa98c75f58a 2023-07-12 22:15:29,996 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 9ec6e68e360406b500e11aa98c75f58a, disabling compactions & flushes 2023-07-12 22:15:29,996 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689200115332.9ec6e68e360406b500e11aa98c75f58a. 2023-07-12 22:15:29,996 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689200115332.9ec6e68e360406b500e11aa98c75f58a. 2023-07-12 22:15:29,996 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689200115332.9ec6e68e360406b500e11aa98c75f58a. after waiting 0 ms 2023-07-12 22:15:29,996 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689200115332.9ec6e68e360406b500e11aa98c75f58a. 2023-07-12 22:15:30,008 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testEmptyExportFileSystemState/a151a7e3b7d5ed6911efa8fe5e530b32/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 22:15:30,009 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 22:15:30,010 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689200115332.a151a7e3b7d5ed6911efa8fe5e530b32. 2023-07-12 22:15:30,010 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for a151a7e3b7d5ed6911efa8fe5e530b32: 2023-07-12 22:15:30,012 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testEmptyExportFileSystemState/9ec6e68e360406b500e11aa98c75f58a/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 22:15:30,012 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 22:15:30,012 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed a151a7e3b7d5ed6911efa8fe5e530b32 2023-07-12 22:15:30,013 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689200115332.9ec6e68e360406b500e11aa98c75f58a. 2023-07-12 22:15:30,014 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 9ec6e68e360406b500e11aa98c75f58a: 2023-07-12 22:15:30,015 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=a151a7e3b7d5ed6911efa8fe5e530b32, regionState=CLOSED 2023-07-12 22:15:30,015 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689200115332.a151a7e3b7d5ed6911efa8fe5e530b32.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689200130015"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689200130015"}]},"ts":"1689200130015"} 2023-07-12 22:15:30,016 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 9ec6e68e360406b500e11aa98c75f58a 2023-07-12 22:15:30,016 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=9ec6e68e360406b500e11aa98c75f58a, regionState=CLOSED 2023-07-12 22:15:30,016 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689200115332.9ec6e68e360406b500e11aa98c75f58a.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689200130016"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689200130016"}]},"ts":"1689200130016"} 2023-07-12 22:15:30,019 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=100 2023-07-12 22:15:30,019 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=100, state=SUCCESS; CloseRegionProcedure a151a7e3b7d5ed6911efa8fe5e530b32, server=jenkins-hbase4.apache.org,34497,1689200016186 in 179 msec 2023-07-12 22:15:30,020 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=101 2023-07-12 22:15:30,020 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=101, state=SUCCESS; CloseRegionProcedure 9ec6e68e360406b500e11aa98c75f58a, server=jenkins-hbase4.apache.org,40411,1689200016125 in 180 msec 2023-07-12 22:15:30,021 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=a151a7e3b7d5ed6911efa8fe5e530b32, UNASSIGN in 189 msec 2023-07-12 22:15:30,023 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=101, resume processing ppid=99 2023-07-12 22:15:30,023 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=9ec6e68e360406b500e11aa98c75f58a, UNASSIGN in 190 msec 2023-07-12 22:15:30,023 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689200130023"}]},"ts":"1689200130023"} 2023-07-12 22:15:30,026 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-07-12 22:15:30,028 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-07-12 22:15:30,031 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 213 msec 2023-07-12 22:15:30,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-12 22:15:30,129 INFO [Listener at jenkins-hbase4.apache.org/41531] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-07-12 22:15:30,130 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-07-12 22:15:30,131 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-12 22:15:30,134 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-12 22:15:30,134 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-07-12 22:15:30,134 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-12 22:15:30,136 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34497] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-07-12 22:15:30,139 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testEmptyExportFileSystemState/9ec6e68e360406b500e11aa98c75f58a 2023-07-12 22:15:30,139 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testEmptyExportFileSystemState/a151a7e3b7d5ed6911efa8fe5e530b32 2023-07-12 22:15:30,140 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-12 22:15:30,140 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-12 22:15:30,141 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-12 22:15:30,141 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-12 22:15:30,142 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-12 22:15:30,142 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-12 22:15:30,143 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-12 22:15:30,143 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-12 22:15:30,143 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-12 22:15:30,143 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-12 22:15:30,143 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 22:15:30,143 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-12 22:15:30,143 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 22:15:30,144 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 22:15:30,144 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testEmptyExportFileSystemState/9ec6e68e360406b500e11aa98c75f58a/cf, FileablePath, hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testEmptyExportFileSystemState/9ec6e68e360406b500e11aa98c75f58a/recovered.edits] 2023-07-12 22:15:30,146 DEBUG [HFileArchiver-21] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testEmptyExportFileSystemState/a151a7e3b7d5ed6911efa8fe5e530b32/cf, FileablePath, hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testEmptyExportFileSystemState/a151a7e3b7d5ed6911efa8fe5e530b32/recovered.edits] 2023-07-12 22:15:30,146 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-12 22:15:30,147 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 22:15:30,148 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-12 22:15:30,152 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testEmptyExportFileSystemState/9ec6e68e360406b500e11aa98c75f58a/cf/8b972878d0684d1ea70279760ed1c98d to hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/archive/data/default/testtb-testEmptyExportFileSystemState/9ec6e68e360406b500e11aa98c75f58a/cf/8b972878d0684d1ea70279760ed1c98d 2023-07-12 22:15:30,153 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testEmptyExportFileSystemState/a151a7e3b7d5ed6911efa8fe5e530b32/cf/18055cbf13494a23bbde5de5ef16ef51 to hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/archive/data/default/testtb-testEmptyExportFileSystemState/a151a7e3b7d5ed6911efa8fe5e530b32/cf/18055cbf13494a23bbde5de5ef16ef51 2023-07-12 22:15:30,156 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testEmptyExportFileSystemState/9ec6e68e360406b500e11aa98c75f58a/recovered.edits/9.seqid to hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/archive/data/default/testtb-testEmptyExportFileSystemState/9ec6e68e360406b500e11aa98c75f58a/recovered.edits/9.seqid 2023-07-12 22:15:30,156 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testEmptyExportFileSystemState/a151a7e3b7d5ed6911efa8fe5e530b32/recovered.edits/9.seqid to hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/archive/data/default/testtb-testEmptyExportFileSystemState/a151a7e3b7d5ed6911efa8fe5e530b32/recovered.edits/9.seqid 2023-07-12 22:15:30,156 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testEmptyExportFileSystemState/9ec6e68e360406b500e11aa98c75f58a 2023-07-12 22:15:30,156 DEBUG [HFileArchiver-21] backup.HFileArchiver(596): Deleted hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testEmptyExportFileSystemState/a151a7e3b7d5ed6911efa8fe5e530b32 2023-07-12 22:15:30,156 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-12 22:15:30,157 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-07-12 22:15:30,158 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf] 2023-07-12 22:15:30,161 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b2023071223f5b933190048ce8f7c718dcc766db7 to hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b2023071223f5b933190048ce8f7c718dcc766db7 2023-07-12 22:15:30,162 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230712a1ccefc52d3446739648074921372ca3 to hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230712a1ccefc52d3446739648074921372ca3 2023-07-12 22:15:30,163 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-07-12 22:15:30,165 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-12 22:15:30,167 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-07-12 22:15:30,169 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-07-12 22:15:30,170 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-12 22:15:30,170 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-07-12 22:15:30,170 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1689200115332.a151a7e3b7d5ed6911efa8fe5e530b32.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689200130170"}]},"ts":"9223372036854775807"} 2023-07-12 22:15:30,170 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1689200115332.9ec6e68e360406b500e11aa98c75f58a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689200130170"}]},"ts":"9223372036854775807"} 2023-07-12 22:15:30,172 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-12 22:15:30,172 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => a151a7e3b7d5ed6911efa8fe5e530b32, NAME => 'testtb-testEmptyExportFileSystemState,,1689200115332.a151a7e3b7d5ed6911efa8fe5e530b32.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 9ec6e68e360406b500e11aa98c75f58a, NAME => 'testtb-testEmptyExportFileSystemState,1,1689200115332.9ec6e68e360406b500e11aa98c75f58a.', STARTKEY => '1', ENDKEY => ''}] 2023-07-12 22:15:30,172 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-07-12 22:15:30,172 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689200130172"}]},"ts":"9223372036854775807"} 2023-07-12 22:15:30,174 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-07-12 22:15:30,175 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-12 22:15:30,177 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 45 msec 2023-07-12 22:15:30,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-12 22:15:30,249 INFO [Listener at jenkins-hbase4.apache.org/41531] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-07-12 22:15:30,257 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-07-12 22:15:30,259 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:30,260 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-07-12 22:15:30,262 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:30,290 INFO [Listener at jenkins-hbase4.apache.org/41531] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=759 (was 758) Potentially hanging thread: hconnection-0x407c7a8e-shared-pool-37 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (337744187) connection to jenkins-hbase4.apache.org/172.31.14.131:42881 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (337744187) connection to jenkins-hbase4.apache.org/172.31.14.131:42257 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1346150702_17 at /127.0.0.1:37608 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x407c7a8e-shared-pool-39 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4670 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_863378824_1 at /127.0.0.1:34496 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1346150702_17 at /127.0.0.1:37822 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x407c7a8e-shared-pool-38 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-21 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x407c7a8e-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1346150702_17 at /127.0.0.1:34516 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (337744187) connection to jenkins-hbase4.apache.org/172.31.14.131:36909 from appattempt_1689200025069_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=921 (was 905) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=786 (was 687) - SystemLoadAverage LEAK? -, ProcessCount=181 (was 179) - ProcessCount LEAK? -, AvailableMemoryMB=3293 (was 4494) 2023-07-12 22:15:30,290 WARN [Listener at jenkins-hbase4.apache.org/41531] hbase.ResourceChecker(130): Thread=759 is superior to 500 2023-07-12 22:15:30,321 INFO [Listener at jenkins-hbase4.apache.org/41531] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=759, OpenFileDescriptor=921, MaxFileDescriptor=60000, SystemLoadAverage=786, ProcessCount=181, AvailableMemoryMB=3291 2023-07-12 22:15:30,321 WARN [Listener at jenkins-hbase4.apache.org/41531] hbase.ResourceChecker(130): Thread=759 is superior to 500 2023-07-12 22:15:30,323 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-12 22:15:30,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:30,327 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 22:15:30,327 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-07-12 22:15:30,328 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 22:15:30,330 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-12 22:15:30,331 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/93fc17815bb5bc270d9c122167199625 2023-07-12 22:15:30,331 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c3f6b1a3d393a8d618cc99cda8b18f55 2023-07-12 22:15:30,332 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/93fc17815bb5bc270d9c122167199625 empty. 2023-07-12 22:15:30,332 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c3f6b1a3d393a8d618cc99cda8b18f55 empty. 2023-07-12 22:15:30,333 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c3f6b1a3d393a8d618cc99cda8b18f55 2023-07-12 22:15:30,333 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/93fc17815bb5bc270d9c122167199625 2023-07-12 22:15:30,333 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-12 22:15:30,397 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-07-12 22:15:30,399 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => 93fc17815bb5bc270d9c122167199625, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689200130323.93fc17815bb5bc270d9c122167199625.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp 2023-07-12 22:15:30,420 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => c3f6b1a3d393a8d618cc99cda8b18f55, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689200130323.c3f6b1a3d393a8d618cc99cda8b18f55.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp 2023-07-12 22:15:30,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-12 22:15:30,511 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689200130323.93fc17815bb5bc270d9c122167199625.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 22:15:30,511 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing 93fc17815bb5bc270d9c122167199625, disabling compactions & flushes 2023-07-12 22:15:30,511 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689200130323.93fc17815bb5bc270d9c122167199625. 2023-07-12 22:15:30,511 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689200130323.93fc17815bb5bc270d9c122167199625. 2023-07-12 22:15:30,511 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689200130323.93fc17815bb5bc270d9c122167199625. after waiting 0 ms 2023-07-12 22:15:30,511 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689200130323.93fc17815bb5bc270d9c122167199625. 2023-07-12 22:15:30,511 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689200130323.93fc17815bb5bc270d9c122167199625. 2023-07-12 22:15:30,511 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for 93fc17815bb5bc270d9c122167199625: 2023-07-12 22:15:30,515 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689200130323.c3f6b1a3d393a8d618cc99cda8b18f55.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 22:15:30,515 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing c3f6b1a3d393a8d618cc99cda8b18f55, disabling compactions & flushes 2023-07-12 22:15:30,515 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689200130323.c3f6b1a3d393a8d618cc99cda8b18f55. 2023-07-12 22:15:30,515 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689200130323.c3f6b1a3d393a8d618cc99cda8b18f55. 2023-07-12 22:15:30,515 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689200130323.c3f6b1a3d393a8d618cc99cda8b18f55. after waiting 0 ms 2023-07-12 22:15:30,515 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689200130323.c3f6b1a3d393a8d618cc99cda8b18f55. 2023-07-12 22:15:30,516 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689200130323.c3f6b1a3d393a8d618cc99cda8b18f55. 2023-07-12 22:15:30,516 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for c3f6b1a3d393a8d618cc99cda8b18f55: 2023-07-12 22:15:30,518 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 22:15:30,519 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689200130323.93fc17815bb5bc270d9c122167199625.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689200130519"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689200130519"}]},"ts":"1689200130519"} 2023-07-12 22:15:30,520 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689200130323.c3f6b1a3d393a8d618cc99cda8b18f55.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689200130519"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689200130519"}]},"ts":"1689200130519"} 2023-07-12 22:15:30,524 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-12 22:15:30,525 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 22:15:30,525 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689200130525"}]},"ts":"1689200130525"} 2023-07-12 22:15:30,526 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-07-12 22:15:30,530 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-12 22:15:30,532 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 22:15:30,532 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 22:15:30,532 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-12 22:15:30,532 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 22:15:30,532 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=93fc17815bb5bc270d9c122167199625, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=c3f6b1a3d393a8d618cc99cda8b18f55, ASSIGN}] 2023-07-12 22:15:30,536 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=93fc17815bb5bc270d9c122167199625, ASSIGN 2023-07-12 22:15:30,537 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=93fc17815bb5bc270d9c122167199625, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37349,1689200016037; forceNewPlan=false, retain=false 2023-07-12 22:15:30,538 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=c3f6b1a3d393a8d618cc99cda8b18f55, ASSIGN 2023-07-12 22:15:30,539 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=c3f6b1a3d393a8d618cc99cda8b18f55, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40411,1689200016125; forceNewPlan=false, retain=false 2023-07-12 22:15:30,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-12 22:15:30,687 INFO [jenkins-hbase4:43225] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-12 22:15:30,691 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=c3f6b1a3d393a8d618cc99cda8b18f55, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:15:30,691 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689200130323.c3f6b1a3d393a8d618cc99cda8b18f55.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689200130691"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689200130691"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689200130691"}]},"ts":"1689200130691"} 2023-07-12 22:15:30,692 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=93fc17815bb5bc270d9c122167199625, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:15:30,692 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689200130323.93fc17815bb5bc270d9c122167199625.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689200130692"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689200130692"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689200130692"}]},"ts":"1689200130692"} 2023-07-12 22:15:30,694 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=108, ppid=107, state=RUNNABLE; OpenRegionProcedure c3f6b1a3d393a8d618cc99cda8b18f55, server=jenkins-hbase4.apache.org,40411,1689200016125}] 2023-07-12 22:15:30,695 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=106, state=RUNNABLE; OpenRegionProcedure 93fc17815bb5bc270d9c122167199625, server=jenkins-hbase4.apache.org,37349,1689200016037}] 2023-07-12 22:15:30,856 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1689200130323.93fc17815bb5bc270d9c122167199625. 2023-07-12 22:15:30,856 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 93fc17815bb5bc270d9c122167199625, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689200130323.93fc17815bb5bc270d9c122167199625.', STARTKEY => '', ENDKEY => '1'} 2023-07-12 22:15:30,856 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1689200130323.93fc17815bb5bc270d9c122167199625. service=AccessControlService 2023-07-12 22:15:30,857 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 22:15:30,856 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1689200130323.c3f6b1a3d393a8d618cc99cda8b18f55. 2023-07-12 22:15:30,857 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c3f6b1a3d393a8d618cc99cda8b18f55, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689200130323.c3f6b1a3d393a8d618cc99cda8b18f55.', STARTKEY => '1', ENDKEY => ''} 2023-07-12 22:15:30,857 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1689200130323.c3f6b1a3d393a8d618cc99cda8b18f55. service=AccessControlService 2023-07-12 22:15:30,858 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 22:15:30,858 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp c3f6b1a3d393a8d618cc99cda8b18f55 2023-07-12 22:15:30,858 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689200130323.c3f6b1a3d393a8d618cc99cda8b18f55.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 22:15:30,858 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c3f6b1a3d393a8d618cc99cda8b18f55 2023-07-12 22:15:30,858 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c3f6b1a3d393a8d618cc99cda8b18f55 2023-07-12 22:15:30,858 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 93fc17815bb5bc270d9c122167199625 2023-07-12 22:15:30,858 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689200130323.93fc17815bb5bc270d9c122167199625.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 22:15:30,859 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 93fc17815bb5bc270d9c122167199625 2023-07-12 22:15:30,859 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 93fc17815bb5bc270d9c122167199625 2023-07-12 22:15:30,863 INFO [StoreOpener-c3f6b1a3d393a8d618cc99cda8b18f55-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region c3f6b1a3d393a8d618cc99cda8b18f55 2023-07-12 22:15:30,863 INFO [StoreOpener-93fc17815bb5bc270d9c122167199625-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 93fc17815bb5bc270d9c122167199625 2023-07-12 22:15:30,865 DEBUG [StoreOpener-c3f6b1a3d393a8d618cc99cda8b18f55-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testExportFileSystemStateWithSkipTmp/c3f6b1a3d393a8d618cc99cda8b18f55/cf 2023-07-12 22:15:30,865 DEBUG [StoreOpener-c3f6b1a3d393a8d618cc99cda8b18f55-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testExportFileSystemStateWithSkipTmp/c3f6b1a3d393a8d618cc99cda8b18f55/cf 2023-07-12 22:15:30,865 DEBUG [StoreOpener-93fc17815bb5bc270d9c122167199625-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testExportFileSystemStateWithSkipTmp/93fc17815bb5bc270d9c122167199625/cf 2023-07-12 22:15:30,865 DEBUG [StoreOpener-93fc17815bb5bc270d9c122167199625-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testExportFileSystemStateWithSkipTmp/93fc17815bb5bc270d9c122167199625/cf 2023-07-12 22:15:30,865 INFO [StoreOpener-93fc17815bb5bc270d9c122167199625-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 93fc17815bb5bc270d9c122167199625 columnFamilyName cf 2023-07-12 22:15:30,865 INFO [StoreOpener-c3f6b1a3d393a8d618cc99cda8b18f55-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c3f6b1a3d393a8d618cc99cda8b18f55 columnFamilyName cf 2023-07-12 22:15:30,867 INFO [StoreOpener-c3f6b1a3d393a8d618cc99cda8b18f55-1] regionserver.HStore(310): Store=c3f6b1a3d393a8d618cc99cda8b18f55/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 22:15:30,867 INFO [StoreOpener-93fc17815bb5bc270d9c122167199625-1] regionserver.HStore(310): Store=93fc17815bb5bc270d9c122167199625/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 22:15:30,868 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testExportFileSystemStateWithSkipTmp/c3f6b1a3d393a8d618cc99cda8b18f55 2023-07-12 22:15:30,868 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testExportFileSystemStateWithSkipTmp/93fc17815bb5bc270d9c122167199625 2023-07-12 22:15:30,868 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testExportFileSystemStateWithSkipTmp/c3f6b1a3d393a8d618cc99cda8b18f55 2023-07-12 22:15:30,868 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testExportFileSystemStateWithSkipTmp/93fc17815bb5bc270d9c122167199625 2023-07-12 22:15:30,871 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 93fc17815bb5bc270d9c122167199625 2023-07-12 22:15:30,871 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c3f6b1a3d393a8d618cc99cda8b18f55 2023-07-12 22:15:30,875 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testExportFileSystemStateWithSkipTmp/93fc17815bb5bc270d9c122167199625/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 22:15:30,875 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 93fc17815bb5bc270d9c122167199625; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75052541, jitterRate=0.11837001144886017}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 22:15:30,875 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 93fc17815bb5bc270d9c122167199625: 2023-07-12 22:15:30,875 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testExportFileSystemStateWithSkipTmp/c3f6b1a3d393a8d618cc99cda8b18f55/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 22:15:30,876 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c3f6b1a3d393a8d618cc99cda8b18f55; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63848942, jitterRate=-0.04857662320137024}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 22:15:30,876 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1689200130323.93fc17815bb5bc270d9c122167199625., pid=109, masterSystemTime=1689200130848 2023-07-12 22:15:30,876 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c3f6b1a3d393a8d618cc99cda8b18f55: 2023-07-12 22:15:30,877 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1689200130323.c3f6b1a3d393a8d618cc99cda8b18f55., pid=108, masterSystemTime=1689200130848 2023-07-12 22:15:30,877 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1689200130323.93fc17815bb5bc270d9c122167199625. 2023-07-12 22:15:30,878 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1689200130323.93fc17815bb5bc270d9c122167199625. 2023-07-12 22:15:30,878 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=93fc17815bb5bc270d9c122167199625, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:15:30,879 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689200130323.93fc17815bb5bc270d9c122167199625.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689200130878"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689200130878"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689200130878"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689200130878"}]},"ts":"1689200130878"} 2023-07-12 22:15:30,879 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1689200130323.c3f6b1a3d393a8d618cc99cda8b18f55. 2023-07-12 22:15:30,879 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=c3f6b1a3d393a8d618cc99cda8b18f55, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:15:30,879 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1689200130323.c3f6b1a3d393a8d618cc99cda8b18f55. 2023-07-12 22:15:30,880 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689200130323.c3f6b1a3d393a8d618cc99cda8b18f55.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689200130879"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689200130879"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689200130879"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689200130879"}]},"ts":"1689200130879"} 2023-07-12 22:15:30,886 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=106 2023-07-12 22:15:30,886 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=106, state=SUCCESS; OpenRegionProcedure 93fc17815bb5bc270d9c122167199625, server=jenkins-hbase4.apache.org,37349,1689200016037 in 188 msec 2023-07-12 22:15:30,887 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=108, resume processing ppid=107 2023-07-12 22:15:30,887 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=107, state=SUCCESS; OpenRegionProcedure c3f6b1a3d393a8d618cc99cda8b18f55, server=jenkins-hbase4.apache.org,40411,1689200016125 in 190 msec 2023-07-12 22:15:30,888 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=93fc17815bb5bc270d9c122167199625, ASSIGN in 354 msec 2023-07-12 22:15:30,890 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=107, resume processing ppid=105 2023-07-12 22:15:30,890 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=c3f6b1a3d393a8d618cc99cda8b18f55, ASSIGN in 355 msec 2023-07-12 22:15:30,891 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 22:15:30,891 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689200130891"}]},"ts":"1689200130891"} 2023-07-12 22:15:30,893 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-07-12 22:15:30,896 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 22:15:30,897 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-07-12 22:15:30,898 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34497] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-12 22:15:30,900 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 22:15:30,900 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 22:15:30,901 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-12 22:15:30,901 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-12 22:15:30,900 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 22:15:30,900 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 22:15:30,903 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 578 msec 2023-07-12 22:15:30,904 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-12 22:15:30,904 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-12 22:15:30,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-12 22:15:30,941 INFO [Listener at jenkins-hbase4.apache.org/41531] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-07-12 22:15:30,944 DEBUG [Listener at jenkins-hbase4.apache.org/41531] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:30,944 DEBUG [Listener at jenkins-hbase4.apache.org/41531] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1689200130323.93fc17815bb5bc270d9c122167199625. 2023-07-12 22:15:30,946 INFO [Listener at jenkins-hbase4.apache.org/41531] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 22:15:30,974 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-12 22:15:30,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689200130974 (current time:1689200130974). 2023-07-12 22:15:30,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 22:15:30,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] zookeeper.ReadOnlyZKClient(139): Connect 0x199a64de to 127.0.0.1:62393 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 22:15:30,992 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@bbaecff, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 22:15:30,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 22:15:31,003 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40322, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 22:15:31,004 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x199a64de to 127.0.0.1:62393 2023-07-12 22:15:31,005 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 22:15:31,005 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] zookeeper.ReadOnlyZKClient(139): Connect 0x10d97a58 to 127.0.0.1:62393 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 22:15:31,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5a2f4009, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 22:15:31,112 DEBUG [hconnection-0x62e92a7-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 22:15:31,116 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40324, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 22:15:31,121 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 22:15:31,124 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39000, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 22:15:31,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x10d97a58 to 127.0.0.1:62393 2023-07-12 22:15:31,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 22:15:31,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-12 22:15:31,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 22:15:31,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-12 22:15:31,128 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] procedure2.ProcedureExecutor(1029): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-12 22:15:31,130 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-12 22:15:31,131 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689200731130 2023-07-12 22:15:31,131 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-12 22:15:31,131 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,132 DEBUG [Listener at jenkins-hbase4.apache.org/41531] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 22:15:31,132 DEBUG [Listener at jenkins-hbase4.apache.org/41531] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 22:15:31,133 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-12 22:15:31,140 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-12 22:15:31,142 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 12 msec 2023-07-12 22:15:31,146 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-12 22:15:31,147 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689200731147 2023-07-12 22:15:31,187 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,187 INFO [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-12 22:15:31,187 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 22:15:31,189 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-12 22:15:31,189 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-12 22:15:31,190 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,191 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,192 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:15:31,192 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:15:31,192 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:15:31,192 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:15:31,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:15:31,192 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:15:31,192 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:15:31,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:15:31,192 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:15:31,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:15:31,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,193 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,193 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,194 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,193 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:15:31,194 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:15:31,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-12 22:15:31,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-12 22:15:31,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,194 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-12 22:15:31,194 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-12 22:15:31,195 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,195 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-12 22:15:31,195 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 22:15:31,195 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,195 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-12 22:15:31,195 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 22:15:31,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-12 22:15:31,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,197 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-12 22:15:31,197 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-12 22:15:31,197 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-12 22:15:31,197 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-12 22:15:31,197 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-12 22:15:31,197 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37349,1689200016037' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-12 22:15:31,195 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:15:31,197 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 22:15:31,197 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34497,1689200016186' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-12 22:15:31,197 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,198 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-12 22:15:31,198 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 22:15:31,199 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-12 22:15:31,199 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-12 22:15:31,199 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40411,1689200016125' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-12 22:15:31,204 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:15:31,204 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:15:31,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 22:15:31,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 22:15:31,205 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 22:15:31,205 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,205 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 22:15:31,206 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:15:31,206 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,206 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,206 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 22:15:31,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 22:15:31,206 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,206 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 22:15:31,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:15:31,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:15:31,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:15:31,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 22:15:31,208 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37349,1689200016037' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-12 22:15:31,208 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3d408526[Count = 1] remaining members to acquire global barrier 2023-07-12 22:15:31,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:15:31,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 22:15:31,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 22:15:31,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 22:15:31,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 22:15:31,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:15:31,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:15:31,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:15:31,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 22:15:31,216 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40411,1689200016125' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-12 22:15:31,216 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3d408526[Count = 0] remaining members to acquire global barrier 2023-07-12 22:15:31,216 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-12 22:15:31,216 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,218 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,218 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,218 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,218 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,218 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,218 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,219 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-12 22:15:31,219 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-12 22:15:31,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,219 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-12 22:15:31,219 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-12 22:15:31,219 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,34497,1689200016186' in zk 2023-07-12 22:15:31,219 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:15:31,220 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:15:31,220 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 22:15:31,221 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-12 22:15:31,221 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 22:15:31,221 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-12 22:15:31,222 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 22:15:31,223 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 22:15:31,223 DEBUG [rs(jenkins-hbase4.apache.org,40411,1689200016125)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689200130323.c3f6b1a3d393a8d618cc99cda8b18f55. 2023-07-12 22:15:31,226 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 22:15:31,226 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 22:15:31,226 DEBUG [rs(jenkins-hbase4.apache.org,37349,1689200016037)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689200130323.93fc17815bb5bc270d9c122167199625. 2023-07-12 22:15:31,226 DEBUG [rs(jenkins-hbase4.apache.org,37349,1689200016037)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689200130323.93fc17815bb5bc270d9c122167199625. started... 2023-07-12 22:15:31,227 DEBUG [rs(jenkins-hbase4.apache.org,37349,1689200016037)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 93fc17815bb5bc270d9c122167199625: 2023-07-12 22:15:31,227 DEBUG [rs(jenkins-hbase4.apache.org,40411,1689200016125)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689200130323.c3f6b1a3d393a8d618cc99cda8b18f55. started... 2023-07-12 22:15:31,227 DEBUG [rs(jenkins-hbase4.apache.org,37349,1689200016037)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689200130323.93fc17815bb5bc270d9c122167199625.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,227 DEBUG [rs(jenkins-hbase4.apache.org,37349,1689200016037)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 22:15:31,229 DEBUG [rs(jenkins-hbase4.apache.org,37349,1689200016037)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 22:15:31,230 DEBUG [rs(jenkins-hbase4.apache.org,40411,1689200016125)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c3f6b1a3d393a8d618cc99cda8b18f55: 2023-07-12 22:15:31,230 DEBUG [rs(jenkins-hbase4.apache.org,40411,1689200016125)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689200130323.c3f6b1a3d393a8d618cc99cda8b18f55.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,230 DEBUG [rs(jenkins-hbase4.apache.org,40411,1689200016125)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 22:15:31,230 DEBUG [rs(jenkins-hbase4.apache.org,40411,1689200016125)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 22:15:31,233 DEBUG [Listener at jenkins-hbase4.apache.org/41531] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 22:15:31,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-12 22:15:31,234 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-12 22:15:31,234 DEBUG [Listener at jenkins-hbase4.apache.org/41531] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 22:15:31,257 DEBUG [rs(jenkins-hbase4.apache.org,37349,1689200016037)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689200130323.93fc17815bb5bc270d9c122167199625. completed. 2023-07-12 22:15:31,258 DEBUG [rs(jenkins-hbase4.apache.org,37349,1689200016037)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689200130323.93fc17815bb5bc270d9c122167199625. 2023-07-12 22:15:31,258 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 22:15:31,258 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 22:15:31,258 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:15:31,258 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-12 22:15:31,258 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,37349,1689200016037' in zk 2023-07-12 22:15:31,260 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-12 22:15:31,260 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:15:31,260 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 22:15:31,260 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-12 22:15:31,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:15:31,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 22:15:31,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 22:15:31,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 22:15:31,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 22:15:31,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:15:31,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:15:31,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:15:31,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 22:15:31,265 DEBUG [rs(jenkins-hbase4.apache.org,40411,1689200016125)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689200130323.c3f6b1a3d393a8d618cc99cda8b18f55. completed. 2023-07-12 22:15:31,265 DEBUG [rs(jenkins-hbase4.apache.org,40411,1689200016125)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689200130323.c3f6b1a3d393a8d618cc99cda8b18f55. 2023-07-12 22:15:31,265 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 22:15:31,265 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 22:15:31,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,265 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:15:31,265 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-12 22:15:31,265 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,40411,1689200016125' in zk 2023-07-12 22:15:31,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:15:31,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:15:31,267 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:15:31,267 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-12 22:15:31,267 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 22:15:31,267 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-12 22:15:31,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,37349,1689200016037': 2023-07-12 22:15:31,271 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37349,1689200016037' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-12 22:15:31,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:15:31,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 22:15:31,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 22:15:31,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 22:15:31,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 22:15:31,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:15:31,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:15:31,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:15:31,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 22:15:31,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:15:31,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:15:31,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:15:31,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,40411,1689200016125': 2023-07-12 22:15:31,275 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40411,1689200016125' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-12 22:15:31,275 INFO [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-12 22:15:31,275 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 22:15:31,275 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 22:15:31,275 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,275 INFO [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 22:15:31,277 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,277 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,277 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,277 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,277 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:15:31,277 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,277 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,277 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:15:31,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 22:15:31,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 22:15:31,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,277 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,277 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:15:31,277 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:15:31,277 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:15:31,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 22:15:31,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:15:31,278 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:15:31,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:15:31,278 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:15:31,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:15:31,278 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:15:31,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,278 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:15:31,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 22:15:31,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:15:31,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:15:31,280 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:15:31,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:15:31,281 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:15:31,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 22:15:31,281 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:15:31,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:15:31,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:15:31,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:15:31,285 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:15:31,285 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:15:31,285 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:15:31,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:15:31,285 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:15:31,286 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:15:31,286 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:15:31,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:15:31,286 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:15:31,286 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,286 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:15:31,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:15:31,286 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:15:31,286 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:15:31,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:15:31,286 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:15:31,286 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,286 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:15:31,286 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,287 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:15:31,287 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:15:31,287 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,287 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,287 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 22:15:31,287 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,287 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,287 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,287 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-12 22:15:31,290 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:15:31,290 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:15:31,290 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:15:31,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:15:31,290 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-12 22:15:31,290 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:15:31,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:15:31,308 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,309 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,399 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,434 DEBUG [Listener at jenkins-hbase4.apache.org/41531] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 22:15:31,435 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-12 22:15:31,435 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-12 22:15:31,436 DEBUG [Listener at jenkins-hbase4.apache.org/41531] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-12 22:15:31,473 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-12 22:15:31,473 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,474 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,474 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689200131131Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1689200131308 (+177 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689200131308Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689200131309 (+1 ms)Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689200131321 (+12 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689200131386 (+65 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689200131473 (+87 ms) 2023-07-12 22:15:31,478 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-12 22:15:31,479 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 346 msec 2023-07-12 22:15:31,736 DEBUG [Listener at jenkins-hbase4.apache.org/41531] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 22:15:31,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-12 22:15:31,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 22:15:31,745 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37349] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1689200130323.93fc17815bb5bc270d9c122167199625. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 22:15:31,748 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40411] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1689200130323.c3f6b1a3d393a8d618cc99cda8b18f55. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 22:15:31,754 DEBUG [Listener at jenkins-hbase4.apache.org/41531] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,754 DEBUG [Listener at jenkins-hbase4.apache.org/41531] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1689200130323.93fc17815bb5bc270d9c122167199625. 2023-07-12 22:15:31,754 INFO [Listener at jenkins-hbase4.apache.org/41531] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 22:15:31,781 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-12 22:15:31,781 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689200131781 (current time:1689200131781). 2023-07-12 22:15:31,781 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 22:15:31,781 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] zookeeper.ReadOnlyZKClient(139): Connect 0x3d448ce9 to 127.0.0.1:62393 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 22:15:31,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4f8d9a4c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 22:15:31,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 22:15:31,798 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40326, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 22:15:31,799 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3d448ce9 to 127.0.0.1:62393 2023-07-12 22:15:31,799 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 22:15:31,800 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] zookeeper.ReadOnlyZKClient(139): Connect 0x114aa19d to 127.0.0.1:62393 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 22:15:31,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@8705499, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 22:15:31,816 DEBUG [hconnection-0x2b0ce021-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 22:15:31,829 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40342, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 22:15:31,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 22:15:31,837 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39014, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 22:15:31,838 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x114aa19d to 127.0.0.1:62393 2023-07-12 22:15:31,838 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 22:15:31,838 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-12 22:15:31,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 22:15:31,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-12 22:15:31,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-12 22:15:31,843 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-12 22:15:31,844 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689200731844 2023-07-12 22:15:31,844 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-12 22:15:31,844 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,846 DEBUG [Listener at jenkins-hbase4.apache.org/41531] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 22:15:31,846 DEBUG [Listener at jenkins-hbase4.apache.org/41531] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 22:15:31,848 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-12 22:15:31,848 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-12 22:15:31,850 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 8 msec 2023-07-12 22:15:31,851 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-12 22:15:31,852 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689200731852 2023-07-12 22:15:31,878 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,879 INFO [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-12 22:15:31,879 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 22:15:31,880 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-12 22:15:31,880 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-12 22:15:31,881 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,881 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,884 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:15:31,884 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:15:31,884 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:15:31,884 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:15:31,884 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:15:31,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:15:31,884 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:15:31,884 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:15:31,884 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:15:31,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:15:31,884 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:15:31,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:15:31,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,885 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:15:31,885 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 22:15:31,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,885 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,885 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,885 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-12 22:15:31,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-12 22:15:31,886 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-12 22:15:31,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-12 22:15:31,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,886 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-12 22:15:31,886 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-12 22:15:31,886 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,886 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,886 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-12 22:15:31,886 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,886 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-12 22:15:31,886 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-12 22:15:31,886 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 22:15:31,886 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 22:15:31,888 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-12 22:15:31,892 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-12 22:15:31,886 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 22:15:31,892 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34497,1689200016186' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-12 22:15:31,892 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-12 22:15:31,894 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-12 22:15:31,894 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37349,1689200016037' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-12 22:15:31,894 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-12 22:15:31,894 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-12 22:15:31,894 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40411,1689200016125' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-12 22:15:31,895 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,895 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:15:31,895 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:15:31,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 22:15:31,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 22:15:31,897 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:15:31,897 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,897 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 22:15:31,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 22:15:31,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,897 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 22:15:31,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:15:31,897 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,897 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 22:15:31,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:15:31,905 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,905 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 22:15:31,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:15:31,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 22:15:31,905 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37349,1689200016037' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-12 22:15:31,905 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@77acacee[Count = 1] remaining members to acquire global barrier 2023-07-12 22:15:31,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:15:31,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 22:15:31,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 22:15:31,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 22:15:31,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 22:15:31,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:15:31,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:15:31,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:15:31,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 22:15:31,910 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40411,1689200016125' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-12 22:15:31,910 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@77acacee[Count = 0] remaining members to acquire global barrier 2023-07-12 22:15:31,910 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-12 22:15:31,910 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,919 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,919 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,919 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,919 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,919 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,919 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:15:31,919 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,919 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-12 22:15:31,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,919 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 22:15:31,919 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 22:15:31,919 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-12 22:15:31,920 DEBUG [rs(jenkins-hbase4.apache.org,40411,1689200016125)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689200130323.c3f6b1a3d393a8d618cc99cda8b18f55. 2023-07-12 22:15:31,919 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-12 22:15:31,920 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-12 22:15:31,919 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:15:31,920 DEBUG [rs(jenkins-hbase4.apache.org,37349,1689200016037)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689200130323.93fc17815bb5bc270d9c122167199625. 2023-07-12 22:15:31,920 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,34497,1689200016186' in zk 2023-07-12 22:15:31,920 DEBUG [rs(jenkins-hbase4.apache.org,37349,1689200016037)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689200130323.93fc17815bb5bc270d9c122167199625. started... 2023-07-12 22:15:31,920 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 22:15:31,920 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 22:15:31,920 DEBUG [rs(jenkins-hbase4.apache.org,40411,1689200016125)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689200130323.c3f6b1a3d393a8d618cc99cda8b18f55. started... 2023-07-12 22:15:31,920 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 22:15:31,920 INFO [rs(jenkins-hbase4.apache.org,37349,1689200016037)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 93fc17815bb5bc270d9c122167199625 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-12 22:15:31,920 INFO [rs(jenkins-hbase4.apache.org,40411,1689200016125)-snapshot-pool-0] regionserver.HRegion(2745): Flushing c3f6b1a3d393a8d618cc99cda8b18f55 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-12 22:15:31,922 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-12 22:15:31,922 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 22:15:31,922 DEBUG [member: 'jenkins-hbase4.apache.org,34497,1689200016186' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-12 22:15:31,946 DEBUG [Listener at jenkins-hbase4.apache.org/41531] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 22:15:31,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-12 22:15:31,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-12 22:15:31,948 DEBUG [Listener at jenkins-hbase4.apache.org/41531] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 22:15:31,953 INFO [rs(jenkins-hbase4.apache.org,37349,1689200016037)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230712595a3d02751f46da82f59c4ba8d016b1 to hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230712595a3d02751f46da82f59c4ba8d016b1 2023-07-12 22:15:31,964 INFO [rs(jenkins-hbase4.apache.org,40411,1689200016125)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230712023d3bc775a845d3a3e75e19eed4d1ca to hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230712023d3bc775a845d3a3e75e19eed4d1ca 2023-07-12 22:15:31,973 INFO [rs(jenkins-hbase4.apache.org,37349,1689200016037)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testExportFileSystemStateWithSkipTmp/93fc17815bb5bc270d9c122167199625/.tmp/cf/b7338c5155014aa3b7e71950d6bd9626 2023-07-12 22:15:31,979 DEBUG [rs(jenkins-hbase4.apache.org,37349,1689200016037)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testExportFileSystemStateWithSkipTmp/93fc17815bb5bc270d9c122167199625/.tmp/cf/b7338c5155014aa3b7e71950d6bd9626 as hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testExportFileSystemStateWithSkipTmp/93fc17815bb5bc270d9c122167199625/cf/b7338c5155014aa3b7e71950d6bd9626 2023-07-12 22:15:31,980 INFO [rs(jenkins-hbase4.apache.org,40411,1689200016125)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testExportFileSystemStateWithSkipTmp/c3f6b1a3d393a8d618cc99cda8b18f55/.tmp/cf/0642ff1e1f60403992602d10f6a4de7b 2023-07-12 22:15:31,986 INFO [rs(jenkins-hbase4.apache.org,37349,1689200016037)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testExportFileSystemStateWithSkipTmp/93fc17815bb5bc270d9c122167199625/cf/b7338c5155014aa3b7e71950d6bd9626, entries=4, sequenceid=6, filesize=5.6 K 2023-07-12 22:15:31,986 DEBUG [rs(jenkins-hbase4.apache.org,40411,1689200016125)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testExportFileSystemStateWithSkipTmp/c3f6b1a3d393a8d618cc99cda8b18f55/.tmp/cf/0642ff1e1f60403992602d10f6a4de7b as hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testExportFileSystemStateWithSkipTmp/c3f6b1a3d393a8d618cc99cda8b18f55/cf/0642ff1e1f60403992602d10f6a4de7b 2023-07-12 22:15:31,987 INFO [rs(jenkins-hbase4.apache.org,37349,1689200016037)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 93fc17815bb5bc270d9c122167199625 in 67ms, sequenceid=6, compaction requested=false 2023-07-12 22:15:31,987 DEBUG [rs(jenkins-hbase4.apache.org,37349,1689200016037)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-07-12 22:15:31,987 DEBUG [rs(jenkins-hbase4.apache.org,37349,1689200016037)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 93fc17815bb5bc270d9c122167199625: 2023-07-12 22:15:31,988 DEBUG [rs(jenkins-hbase4.apache.org,37349,1689200016037)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689200130323.93fc17815bb5bc270d9c122167199625.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,988 DEBUG [rs(jenkins-hbase4.apache.org,37349,1689200016037)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 22:15:31,988 DEBUG [rs(jenkins-hbase4.apache.org,37349,1689200016037)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testExportFileSystemStateWithSkipTmp/93fc17815bb5bc270d9c122167199625/cf/b7338c5155014aa3b7e71950d6bd9626] hfiles 2023-07-12 22:15:31,988 DEBUG [rs(jenkins-hbase4.apache.org,37349,1689200016037)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testExportFileSystemStateWithSkipTmp/93fc17815bb5bc270d9c122167199625/cf/b7338c5155014aa3b7e71950d6bd9626 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:32,003 INFO [rs(jenkins-hbase4.apache.org,40411,1689200016125)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testExportFileSystemStateWithSkipTmp/c3f6b1a3d393a8d618cc99cda8b18f55/cf/0642ff1e1f60403992602d10f6a4de7b, entries=46, sequenceid=6, filesize=13.2 K 2023-07-12 22:15:32,008 INFO [rs(jenkins-hbase4.apache.org,40411,1689200016125)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for c3f6b1a3d393a8d618cc99cda8b18f55 in 88ms, sequenceid=6, compaction requested=false 2023-07-12 22:15:32,011 DEBUG [rs(jenkins-hbase4.apache.org,40411,1689200016125)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c3f6b1a3d393a8d618cc99cda8b18f55: 2023-07-12 22:15:32,011 DEBUG [rs(jenkins-hbase4.apache.org,40411,1689200016125)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689200130323.c3f6b1a3d393a8d618cc99cda8b18f55.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:32,011 DEBUG [rs(jenkins-hbase4.apache.org,40411,1689200016125)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 22:15:32,011 DEBUG [rs(jenkins-hbase4.apache.org,40411,1689200016125)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testExportFileSystemStateWithSkipTmp/c3f6b1a3d393a8d618cc99cda8b18f55/cf/0642ff1e1f60403992602d10f6a4de7b] hfiles 2023-07-12 22:15:32,011 DEBUG [rs(jenkins-hbase4.apache.org,40411,1689200016125)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testExportFileSystemStateWithSkipTmp/c3f6b1a3d393a8d618cc99cda8b18f55/cf/0642ff1e1f60403992602d10f6a4de7b for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:32,107 DEBUG [rs(jenkins-hbase4.apache.org,37349,1689200016037)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689200130323.93fc17815bb5bc270d9c122167199625. completed. 2023-07-12 22:15:32,107 DEBUG [rs(jenkins-hbase4.apache.org,37349,1689200016037)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689200130323.93fc17815bb5bc270d9c122167199625. 2023-07-12 22:15:32,108 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 22:15:32,108 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 22:15:32,108 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:15:32,108 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-12 22:15:32,108 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,37349,1689200016037' in zk 2023-07-12 22:15:32,114 DEBUG [rs(jenkins-hbase4.apache.org,40411,1689200016125)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689200130323.c3f6b1a3d393a8d618cc99cda8b18f55. completed. 2023-07-12 22:15:32,114 DEBUG [rs(jenkins-hbase4.apache.org,40411,1689200016125)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689200130323.c3f6b1a3d393a8d618cc99cda8b18f55. 2023-07-12 22:15:32,114 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 22:15:32,114 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 22:15:32,115 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:15:32,115 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-12 22:15:32,115 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,40411,1689200016125' in zk 2023-07-12 22:15:32,115 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:15:32,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:15:32,116 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-12 22:15:32,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 22:15:32,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 22:15:32,116 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 22:15:32,116 DEBUG [member: 'jenkins-hbase4.apache.org,37349,1689200016037' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-12 22:15:32,119 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:15:32,119 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-12 22:15:32,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 22:15:32,119 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 22:15:32,119 DEBUG [member: 'jenkins-hbase4.apache.org,40411,1689200016125' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-12 22:15:32,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 22:15:32,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:32,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:15:32,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:15:32,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:15:32,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 22:15:32,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:32,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:15:32,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:15:32,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:15:32,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,37349,1689200016037': 2023-07-12 22:15:32,128 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37349,1689200016037' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-12 22:15:32,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:15:32,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 22:15:32,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 22:15:32,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 22:15:32,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 22:15:32,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:32,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:15:32,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:15:32,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:15:32,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 22:15:32,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:32,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:15:32,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:15:32,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:15:32,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,40411,1689200016125': 2023-07-12 22:15:32,135 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40411,1689200016125' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-12 22:15:32,135 INFO [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-12 22:15:32,135 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 22:15:32,135 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 22:15:32,135 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:32,135 INFO [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 22:15:32,139 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:32,139 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:15:32,139 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:32,139 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:32,139 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:32,139 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:32,139 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:15:32,139 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:15:32,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:32,139 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:32,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:32,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:32,140 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:15:32,140 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:15:32,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:15:32,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:15:32,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:32,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:32,141 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:32,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:32,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 22:15:32,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 22:15:32,141 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:15:32,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:15:32,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:32,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 22:15:32,143 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:15:32,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:32,144 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:15:32,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 22:15:32,144 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:15:32,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:32,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:15:32,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:15:32,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:15:32,148 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:15:32,148 DEBUG [Listener at jenkins-hbase4.apache.org/41531] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 22:15:32,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 22:15:32,149 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-12 22:15:32,149 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-12 22:15:32,150 DEBUG [Listener at jenkins-hbase4.apache.org/41531] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-12 22:15:32,151 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:15:32,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:32,152 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:15:32,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:15:32,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:15:32,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:15:32,160 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:15:32,160 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:15:32,160 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:15:32,160 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:15:32,160 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:15:32,160 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:15:32,160 DEBUG [(jenkins-hbase4.apache.org,43225,1689200014499)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 22:15:32,160 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:15:32,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:15:32,160 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:15:32,160 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:15:32,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:15:32,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:15:32,162 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:15:32,163 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:32,163 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:15:32,163 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:15:32,163 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:32,163 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:15:32,163 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:32,163 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:15:32,160 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:32,163 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:32,163 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:32,163 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-12 22:15:32,163 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:15:32,163 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:32,163 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:15:32,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:15:32,163 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:32,164 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:15:32,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:15:32,164 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:15:32,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:15:32,164 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230712023d3bc775a845d3a3e75e19eed4d1ca, hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230712595a3d02751f46da82f59c4ba8d016b1] mob files 2023-07-12 22:15:32,164 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230712023d3bc775a845d3a3e75e19eed4d1ca 2023-07-12 22:15:32,166 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230712595a3d02751f46da82f59c4ba8d016b1 2023-07-12 22:15:32,181 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:32,182 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:32,245 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:32,326 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-12 22:15:32,326 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:32,326 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:32,327 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689200131844Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1689200132181 (+337 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689200132181Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1689200132181Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1689200132186 (+5 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689200132218 (+32 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689200132326 (+108 ms) 2023-07-12 22:15:32,330 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-12 22:15:32,339 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 484 msec 2023-07-12 22:15:32,450 DEBUG [Listener at jenkins-hbase4.apache.org/41531] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 22:15:32,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-12 22:15:32,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 22:15:32,451 INFO [Listener at jenkins-hbase4.apache.org/41531] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/export-test/export-1689200132451 2023-07-12 22:15:32,451 INFO [Listener at jenkins-hbase4.apache.org/41531] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:34335, tgtDir=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/export-test/export-1689200132451, rawTgtDir=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/export-test/export-1689200132451, srcFsUri=hdfs://localhost:34335, srcDir=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967 2023-07-12 22:15:32,476 DEBUG [Listener at jenkins-hbase4.apache.org/41531] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:34335, inputRoot=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967 2023-07-12 22:15:32,476 DEBUG [Listener at jenkins-hbase4.apache.org/41531] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1815406670_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/export-test/export-1689200132451, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/export-test/export-1689200132451/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:32,476 INFO [Listener at jenkins-hbase4.apache.org/41531] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:34335, inputRoot=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967, snapshotDir=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-07-12 22:15:32,486 INFO [Listener at jenkins-hbase4.apache.org/41531] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/export-test/export-1689200132451/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:32,509 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-12 22:15:32,509 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-12 22:15:32,510 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-12 22:15:32,510 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-12 22:15:32,510 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-12 22:15:32,511 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-12 22:15:32,511 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-12 22:15:32,587 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/652e6e64-efb3-f860-57fa-f551f44ecb6b/hadoop-7355857089796774311.jar 2023-07-12 22:15:32,587 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-12 22:15:32,587 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-12 22:15:32,588 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-12 22:15:32,588 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-12 22:15:32,588 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-12 22:15:32,589 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-12 22:15:32,589 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-12 22:15:32,589 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-12 22:15:32,590 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-12 22:15:32,590 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-12 22:15:32,590 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-12 22:15:32,591 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-12 22:15:32,591 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-12 22:15:32,591 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-12 22:15:32,592 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-12 22:15:32,592 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-12 22:15:32,592 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 22:15:32,593 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 22:15:32,593 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 22:15:32,593 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 22:15:32,593 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 22:15:32,594 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 22:15:32,594 DEBUG [Listener at jenkins-hbase4.apache.org/41531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 22:15:33,878 WARN [Listener at jenkins-hbase4.apache.org/41531] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-12 22:15:33,880 INFO [Listener at jenkins-hbase4.apache.org/41531] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-07-12 22:15:33,883 DEBUG [Listener at jenkins-hbase4.apache.org/41531] snapshot.ExportSnapshot(671): export split=0 size=31.5 K 2023-07-12 22:15:34,310 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 22:15:34,311 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 22:15:34,314 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689200025069_0006_000001 (auth:SIMPLE) 2023-07-12 22:15:34,928 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689200025069_0007_000001 (auth:SIMPLE) 2023-07-12 22:15:35,647 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-12 22:15:41,196 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689200025069_0007_000001 (auth:SIMPLE) 2023-07-12 22:15:43,500 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689200025069_0007_000001 (auth:SIMPLE) 2023-07-12 22:15:48,865 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689200025069_0007_000001 (auth:SIMPLE) 2023-07-12 22:15:50,357 INFO [Listener at jenkins-hbase4.apache.org/41531] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-12 22:15:50,357 INFO [Listener at jenkins-hbase4.apache.org/41531] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-12 22:15:50,380 INFO [Listener at jenkins-hbase4.apache.org/41531] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:50,381 INFO [Listener at jenkins-hbase4.apache.org/41531] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-12 22:15:50,381 INFO [Listener at jenkins-hbase4.apache.org/41531] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-12 22:15:50,381 DEBUG [Listener at jenkins-hbase4.apache.org/41531] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1346150702_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:50,382 DEBUG [Listener at jenkins-hbase4.apache.org/41531] snapshot.TestExportSnapshot(367): hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-12 22:15:50,382 DEBUG [Listener at jenkins-hbase4.apache.org/41531] snapshot.TestExportSnapshot(367): hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-12 22:15:50,382 DEBUG [Listener at jenkins-hbase4.apache.org/41531] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1346150702_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/export-test/export-1689200132451/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/export-test/export-1689200132451/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:50,383 DEBUG [Listener at jenkins-hbase4.apache.org/41531] snapshot.TestExportSnapshot(367): hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/export-test/export-1689200132451/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-12 22:15:50,383 DEBUG [Listener at jenkins-hbase4.apache.org/41531] snapshot.TestExportSnapshot(367): hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/export-test/export-1689200132451/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-12 22:15:50,395 INFO [Listener at jenkins-hbase4.apache.org/41531] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:50,395 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:50,396 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] procedure2.ProcedureExecutor(1029): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:50,399 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-12 22:15:50,400 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689200150399"}]},"ts":"1689200150399"} 2023-07-12 22:15:50,401 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-07-12 22:15:50,403 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-07-12 22:15:50,403 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=93fc17815bb5bc270d9c122167199625, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=c3f6b1a3d393a8d618cc99cda8b18f55, UNASSIGN}] 2023-07-12 22:15:50,404 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=93fc17815bb5bc270d9c122167199625, UNASSIGN 2023-07-12 22:15:50,405 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=c3f6b1a3d393a8d618cc99cda8b18f55, UNASSIGN 2023-07-12 22:15:50,406 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=93fc17815bb5bc270d9c122167199625, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:15:50,406 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=c3f6b1a3d393a8d618cc99cda8b18f55, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:15:50,406 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689200130323.93fc17815bb5bc270d9c122167199625.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689200150406"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689200150406"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689200150406"}]},"ts":"1689200150406"} 2023-07-12 22:15:50,406 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689200130323.c3f6b1a3d393a8d618cc99cda8b18f55.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689200150406"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689200150406"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689200150406"}]},"ts":"1689200150406"} 2023-07-12 22:15:50,408 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=115, state=RUNNABLE; CloseRegionProcedure 93fc17815bb5bc270d9c122167199625, server=jenkins-hbase4.apache.org,37349,1689200016037}] 2023-07-12 22:15:50,408 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=118, ppid=116, state=RUNNABLE; CloseRegionProcedure c3f6b1a3d393a8d618cc99cda8b18f55, server=jenkins-hbase4.apache.org,40411,1689200016125}] 2023-07-12 22:15:50,500 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-12 22:15:50,559 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 93fc17815bb5bc270d9c122167199625 2023-07-12 22:15:50,560 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close c3f6b1a3d393a8d618cc99cda8b18f55 2023-07-12 22:15:50,560 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 93fc17815bb5bc270d9c122167199625, disabling compactions & flushes 2023-07-12 22:15:50,560 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689200130323.93fc17815bb5bc270d9c122167199625. 2023-07-12 22:15:50,560 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689200130323.93fc17815bb5bc270d9c122167199625. 2023-07-12 22:15:50,560 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689200130323.93fc17815bb5bc270d9c122167199625. after waiting 0 ms 2023-07-12 22:15:50,560 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689200130323.93fc17815bb5bc270d9c122167199625. 2023-07-12 22:15:50,560 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c3f6b1a3d393a8d618cc99cda8b18f55, disabling compactions & flushes 2023-07-12 22:15:50,560 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689200130323.c3f6b1a3d393a8d618cc99cda8b18f55. 2023-07-12 22:15:50,560 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689200130323.c3f6b1a3d393a8d618cc99cda8b18f55. 2023-07-12 22:15:50,560 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689200130323.c3f6b1a3d393a8d618cc99cda8b18f55. after waiting 0 ms 2023-07-12 22:15:50,560 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689200130323.c3f6b1a3d393a8d618cc99cda8b18f55. 2023-07-12 22:15:50,583 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testExportFileSystemStateWithSkipTmp/c3f6b1a3d393a8d618cc99cda8b18f55/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 22:15:50,583 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/default/testtb-testExportFileSystemStateWithSkipTmp/93fc17815bb5bc270d9c122167199625/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 22:15:50,584 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 22:15:50,584 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 22:15:50,585 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689200130323.93fc17815bb5bc270d9c122167199625. 2023-07-12 22:15:50,585 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689200130323.c3f6b1a3d393a8d618cc99cda8b18f55. 2023-07-12 22:15:50,585 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 93fc17815bb5bc270d9c122167199625: 2023-07-12 22:15:50,585 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c3f6b1a3d393a8d618cc99cda8b18f55: 2023-07-12 22:15:50,588 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=93fc17815bb5bc270d9c122167199625, regionState=CLOSED 2023-07-12 22:15:50,588 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689200130323.93fc17815bb5bc270d9c122167199625.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689200150588"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689200150588"}]},"ts":"1689200150588"} 2023-07-12 22:15:50,588 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 93fc17815bb5bc270d9c122167199625 2023-07-12 22:15:50,589 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed c3f6b1a3d393a8d618cc99cda8b18f55 2023-07-12 22:15:50,589 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=c3f6b1a3d393a8d618cc99cda8b18f55, regionState=CLOSED 2023-07-12 22:15:50,589 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689200130323.c3f6b1a3d393a8d618cc99cda8b18f55.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689200150589"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689200150589"}]},"ts":"1689200150589"} 2023-07-12 22:15:50,591 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=117, resume processing ppid=115 2023-07-12 22:15:50,591 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=115, state=SUCCESS; CloseRegionProcedure 93fc17815bb5bc270d9c122167199625, server=jenkins-hbase4.apache.org,37349,1689200016037 in 182 msec 2023-07-12 22:15:50,592 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=93fc17815bb5bc270d9c122167199625, UNASSIGN in 188 msec 2023-07-12 22:15:50,592 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=118, resume processing ppid=116 2023-07-12 22:15:50,592 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=116, state=SUCCESS; CloseRegionProcedure c3f6b1a3d393a8d618cc99cda8b18f55, server=jenkins-hbase4.apache.org,40411,1689200016125 in 183 msec 2023-07-12 22:15:50,601 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=116, resume processing ppid=114 2023-07-12 22:15:50,601 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=c3f6b1a3d393a8d618cc99cda8b18f55, UNASSIGN in 189 msec 2023-07-12 22:15:50,602 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689200150602"}]},"ts":"1689200150602"} 2023-07-12 22:15:50,603 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-07-12 22:15:50,605 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-07-12 22:15:50,608 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 211 msec 2023-07-12 22:15:50,702 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-12 22:15:50,702 INFO [Listener at jenkins-hbase4.apache.org/41531] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-07-12 22:15:50,703 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:50,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] procedure2.ProcedureExecutor(1029): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:50,706 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:50,707 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:50,707 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:50,714 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34497] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:50,717 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:50,717 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:50,717 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:50,717 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:50,718 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-12 22:15:50,718 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-12 22:15:50,718 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-12 22:15:50,718 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-12 22:15:50,718 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/93fc17815bb5bc270d9c122167199625 2023-07-12 22:15:50,719 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:50,719 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:50,719 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 22:15:50,719 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:50,719 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 22:15:50,719 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:50,719 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 22:15:50,719 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 22:15:50,720 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-12 22:15:50,721 DEBUG [HFileArchiver-23] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c3f6b1a3d393a8d618cc99cda8b18f55 2023-07-12 22:15:50,723 DEBUG [HFileArchiver-22] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/93fc17815bb5bc270d9c122167199625/cf, FileablePath, hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/93fc17815bb5bc270d9c122167199625/recovered.edits] 2023-07-12 22:15:50,723 DEBUG [HFileArchiver-23] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c3f6b1a3d393a8d618cc99cda8b18f55/cf, FileablePath, hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c3f6b1a3d393a8d618cc99cda8b18f55/recovered.edits] 2023-07-12 22:15:50,727 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/93fc17815bb5bc270d9c122167199625/cf/b7338c5155014aa3b7e71950d6bd9626 to hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/93fc17815bb5bc270d9c122167199625/cf/b7338c5155014aa3b7e71950d6bd9626 2023-07-12 22:15:50,728 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c3f6b1a3d393a8d618cc99cda8b18f55/cf/0642ff1e1f60403992602d10f6a4de7b to hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/c3f6b1a3d393a8d618cc99cda8b18f55/cf/0642ff1e1f60403992602d10f6a4de7b 2023-07-12 22:15:50,731 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/93fc17815bb5bc270d9c122167199625/recovered.edits/9.seqid to hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/93fc17815bb5bc270d9c122167199625/recovered.edits/9.seqid 2023-07-12 22:15:50,731 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c3f6b1a3d393a8d618cc99cda8b18f55/recovered.edits/9.seqid to hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/c3f6b1a3d393a8d618cc99cda8b18f55/recovered.edits/9.seqid 2023-07-12 22:15:50,731 DEBUG [HFileArchiver-22] backup.HFileArchiver(596): Deleted hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/93fc17815bb5bc270d9c122167199625 2023-07-12 22:15:50,732 DEBUG [HFileArchiver-23] backup.HFileArchiver(596): Deleted hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c3f6b1a3d393a8d618cc99cda8b18f55 2023-07-12 22:15:50,732 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-12 22:15:50,732 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-07-12 22:15:50,733 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf] 2023-07-12 22:15:50,737 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230712023d3bc775a845d3a3e75e19eed4d1ca to hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230712023d3bc775a845d3a3e75e19eed4d1ca 2023-07-12 22:15:50,738 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230712595a3d02751f46da82f59c4ba8d016b1 to hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230712595a3d02751f46da82f59c4ba8d016b1 2023-07-12 22:15:50,739 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-07-12 22:15:50,741 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:50,744 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-07-12 22:15:50,748 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-07-12 22:15:50,751 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:50,751 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-07-12 22:15:50,751 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689200130323.93fc17815bb5bc270d9c122167199625.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689200150751"}]},"ts":"9223372036854775807"} 2023-07-12 22:15:50,751 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689200130323.c3f6b1a3d393a8d618cc99cda8b18f55.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689200150751"}]},"ts":"9223372036854775807"} 2023-07-12 22:15:50,753 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-12 22:15:50,753 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 93fc17815bb5bc270d9c122167199625, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689200130323.93fc17815bb5bc270d9c122167199625.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => c3f6b1a3d393a8d618cc99cda8b18f55, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689200130323.c3f6b1a3d393a8d618cc99cda8b18f55.', STARTKEY => '1', ENDKEY => ''}] 2023-07-12 22:15:50,753 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-07-12 22:15:50,753 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689200150753"}]},"ts":"9223372036854775807"} 2023-07-12 22:15:50,755 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-07-12 22:15:50,758 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:50,759 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 55 msec 2023-07-12 22:15:50,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-12 22:15:50,821 INFO [Listener at jenkins-hbase4.apache.org/41531] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-07-12 22:15:50,830 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-12 22:15:50,832 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:50,833 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-12 22:15:50,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43225] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:50,863 INFO [Listener at jenkins-hbase4.apache.org/41531] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=762 (was 759) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-23 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x407c7a8e-shared-pool-44 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1346150702_17 at /127.0.0.1:60104 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-5311 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x407c7a8e-shared-pool-42 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x407c7a8e-shared-pool-45 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (337744187) connection to jenkins-hbase4.apache.org/172.31.14.131:44181 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-22 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1346150702_17 at /127.0.0.1:58008 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1346150702_17 at /127.0.0.1:60830 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_381572452_1 at /127.0.0.1:44092 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x407c7a8e-shared-pool-43 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=912 (was 921), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=819 (was 786) - SystemLoadAverage LEAK? -, ProcessCount=179 (was 181), AvailableMemoryMB=2907 (was 3291) 2023-07-12 22:15:50,863 WARN [Listener at jenkins-hbase4.apache.org/41531] hbase.ResourceChecker(130): Thread=762 is superior to 500 2023-07-12 22:15:50,863 INFO [Listener at jenkins-hbase4.apache.org/41531] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-07-12 22:15:50,873 INFO [Listener at jenkins-hbase4.apache.org/41531] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-12 22:15:50,985 WARN [ContainersLauncher #0] nodemanager.DefaultContainerExecutor(305): Exit code from container container_1689200025069_0007_01_000001 is : 143 2023-07-12 22:15:56,169 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-12 22:16:04,991 INFO [Listener at jenkins-hbase4.apache.org/41531] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-12 22:16:19,103 ERROR [Thread[Thread-410,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-12 22:16:19,104 INFO [Listener at jenkins-hbase4.apache.org/41531] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-12 22:16:19,210 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-07-12 22:16:19,217 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-07-12 22:16:19,219 ERROR [Thread[Thread-420,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-12 22:16:19,235 INFO [Listener at jenkins-hbase4.apache.org/41531] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-12 22:16:19,340 ERROR [Thread[Thread-384,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-12 22:16:19,340 INFO [Listener at jenkins-hbase4.apache.org/41531] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-07-12 22:16:19,340 INFO [Listener at jenkins-hbase4.apache.org/41531] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-12 22:16:19,341 INFO [Listener at jenkins-hbase4.apache.org/41531] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-12 22:16:19,341 DEBUG [Listener at jenkins-hbase4.apache.org/41531] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x67106910 to 127.0.0.1:62393 2023-07-12 22:16:19,341 DEBUG [Listener at jenkins-hbase4.apache.org/41531] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 22:16:19,341 DEBUG [Listener at jenkins-hbase4.apache.org/41531] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-12 22:16:19,341 DEBUG [Listener at jenkins-hbase4.apache.org/41531] util.JVMClusterUtil(257): Found active master hash=607402748, stopped=false 2023-07-12 22:16:19,341 DEBUG [Listener at jenkins-hbase4.apache.org/41531] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 22:16:19,341 DEBUG [Listener at jenkins-hbase4.apache.org/41531] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-12 22:16:19,342 INFO [Listener at jenkins-hbase4.apache.org/41531] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,43225,1689200014499 2023-07-12 22:16:19,343 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-12 22:16:19,343 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-12 22:16:19,343 INFO [Listener at jenkins-hbase4.apache.org/41531] procedure2.ProcedureExecutor(629): Stopping 2023-07-12 22:16:19,343 DEBUG [Listener at jenkins-hbase4.apache.org/41531] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4f909175 to 127.0.0.1:62393 2023-07-12 22:16:19,343 DEBUG [Listener at jenkins-hbase4.apache.org/41531] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 22:16:19,344 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 22:16:19,344 INFO [Listener at jenkins-hbase4.apache.org/41531] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,37349,1689200016037' ***** 2023-07-12 22:16:19,344 DEBUG [Listener at jenkins-hbase4.apache.org/41531] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 22:16:19,344 INFO [Listener at jenkins-hbase4.apache.org/41531] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-12 22:16:19,344 INFO [Listener at jenkins-hbase4.apache.org/41531] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,40411,1689200016125' ***** 2023-07-12 22:16:19,344 DEBUG [Listener at jenkins-hbase4.apache.org/41531] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 22:16:19,344 INFO [Listener at jenkins-hbase4.apache.org/41531] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-12 22:16:19,344 INFO [Listener at jenkins-hbase4.apache.org/41531] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,34497,1689200016186' ***** 2023-07-12 22:16:19,344 DEBUG [Listener at jenkins-hbase4.apache.org/41531] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 22:16:19,344 INFO [Listener at jenkins-hbase4.apache.org/41531] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-12 22:16:19,344 INFO [RS:1;jenkins-hbase4:40411] regionserver.HeapMemoryManager(220): Stopping 2023-07-12 22:16:19,344 INFO [RS:2;jenkins-hbase4:34497] regionserver.HeapMemoryManager(220): Stopping 2023-07-12 22:16:19,344 INFO [RS:0;jenkins-hbase4:37349] regionserver.HeapMemoryManager(220): Stopping 2023-07-12 22:16:19,345 INFO [RS:1;jenkins-hbase4:40411] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-12 22:16:19,345 INFO [RS:0;jenkins-hbase4:37349] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-12 22:16:19,345 INFO [RS:1;jenkins-hbase4:40411] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-12 22:16:19,345 INFO [RS:0;jenkins-hbase4:37349] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-12 22:16:19,345 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-12 22:16:19,345 INFO [RS:1;jenkins-hbase4:40411] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:16:19,345 DEBUG [RS:1;jenkins-hbase4:40411] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3d3c59db to 127.0.0.1:62393 2023-07-12 22:16:19,345 INFO [RS:0;jenkins-hbase4:37349] regionserver.HRegionServer(3305): Received CLOSE for e4d70b8a3db9931e0f20d3426a310c90 2023-07-12 22:16:19,345 DEBUG [RS:1;jenkins-hbase4:40411] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 22:16:19,343 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-12 22:16:19,348 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 22:16:19,343 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-12 22:16:19,349 INFO [RS:1;jenkins-hbase4:40411] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-12 22:16:19,349 INFO [RS:1;jenkins-hbase4:40411] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-12 22:16:19,349 INFO [RS:1;jenkins-hbase4:40411] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-12 22:16:19,349 INFO [RS:0;jenkins-hbase4:37349] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:16:19,349 INFO [RS:1;jenkins-hbase4:40411] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-12 22:16:19,348 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-12 22:16:19,345 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-12 22:16:19,345 INFO [RS:2;jenkins-hbase4:34497] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-12 22:16:19,344 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 22:16:19,349 INFO [RS:2;jenkins-hbase4:34497] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-12 22:16:19,349 DEBUG [RS:0;jenkins-hbase4:37349] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x40d64d40 to 127.0.0.1:62393 2023-07-12 22:16:19,349 DEBUG [RS:0;jenkins-hbase4:37349] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 22:16:19,349 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 22:16:19,351 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 22:16:19,354 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-12 22:16:19,358 INFO [RS:1;jenkins-hbase4:40411] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-12 22:16:19,359 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-12 22:16:19,359 INFO [RS:0;jenkins-hbase4:37349] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-12 22:16:19,360 DEBUG [RS:0;jenkins-hbase4:37349] regionserver.HRegionServer(1478): Online Regions={e4d70b8a3db9931e0f20d3426a310c90=hbase:namespace,,1689200019044.e4d70b8a3db9931e0f20d3426a310c90.} 2023-07-12 22:16:19,360 INFO [RS:2;jenkins-hbase4:34497] regionserver.HRegionServer(3305): Received CLOSE for 6bafa9910cce283c65634e629ca8b487 2023-07-12 22:16:19,360 INFO [RS:2;jenkins-hbase4:34497] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:16:19,360 DEBUG [RS:2;jenkins-hbase4:34497] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x62c3a692 to 127.0.0.1:62393 2023-07-12 22:16:19,360 DEBUG [RS:2;jenkins-hbase4:34497] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 22:16:19,361 DEBUG [RS:0;jenkins-hbase4:37349] regionserver.HRegionServer(1504): Waiting on e4d70b8a3db9931e0f20d3426a310c90 2023-07-12 22:16:19,359 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e4d70b8a3db9931e0f20d3426a310c90, disabling compactions & flushes 2023-07-12 22:16:19,360 DEBUG [RS:1;jenkins-hbase4:40411] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-07-12 22:16:19,362 INFO [RS:2;jenkins-hbase4:34497] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-12 22:16:19,362 DEBUG [RS:2;jenkins-hbase4:34497] regionserver.HRegionServer(1478): Online Regions={6bafa9910cce283c65634e629ca8b487=hbase:acl,,1689200019921.6bafa9910cce283c65634e629ca8b487.} 2023-07-12 22:16:19,362 DEBUG [RS:1;jenkins-hbase4:40411] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-12 22:16:19,362 DEBUG [RS:2;jenkins-hbase4:34497] regionserver.HRegionServer(1504): Waiting on 6bafa9910cce283c65634e629ca8b487 2023-07-12 22:16:19,362 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 6bafa9910cce283c65634e629ca8b487, disabling compactions & flushes 2023-07-12 22:16:19,362 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689200019921.6bafa9910cce283c65634e629ca8b487. 2023-07-12 22:16:19,362 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689200019921.6bafa9910cce283c65634e629ca8b487. 2023-07-12 22:16:19,362 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689200019921.6bafa9910cce283c65634e629ca8b487. after waiting 0 ms 2023-07-12 22:16:19,362 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689200019921.6bafa9910cce283c65634e629ca8b487. 2023-07-12 22:16:19,362 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 6bafa9910cce283c65634e629ca8b487 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-07-12 22:16:19,362 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-12 22:16:19,362 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-12 22:16:19,362 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-12 22:16:19,362 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-12 22:16:19,363 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-12 22:16:19,363 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-07-12 22:16:19,361 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689200019044.e4d70b8a3db9931e0f20d3426a310c90. 2023-07-12 22:16:19,363 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689200019044.e4d70b8a3db9931e0f20d3426a310c90. 2023-07-12 22:16:19,363 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689200019044.e4d70b8a3db9931e0f20d3426a310c90. after waiting 0 ms 2023-07-12 22:16:19,363 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689200019044.e4d70b8a3db9931e0f20d3426a310c90. 2023-07-12 22:16:19,363 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing e4d70b8a3db9931e0f20d3426a310c90 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-12 22:16:19,362 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-12 22:16:19,447 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/hbase/namespace/e4d70b8a3db9931e0f20d3426a310c90/.tmp/info/80ca81391854489ab56fe122ddbc906d 2023-07-12 22:16:19,460 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/hbase/meta/1588230740/.tmp/info/09ad365deca644deb93fb72b3fafa8a3 2023-07-12 22:16:19,479 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/hbase/acl/6bafa9910cce283c65634e629ca8b487/.tmp/l/2e85311cd5c148c9ab591ce05894ca95 2023-07-12 22:16:19,485 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/hbase/namespace/e4d70b8a3db9931e0f20d3426a310c90/.tmp/info/80ca81391854489ab56fe122ddbc906d as hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/hbase/namespace/e4d70b8a3db9931e0f20d3426a310c90/info/80ca81391854489ab56fe122ddbc906d 2023-07-12 22:16:19,486 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2e85311cd5c148c9ab591ce05894ca95 2023-07-12 22:16:19,487 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/hbase/acl/6bafa9910cce283c65634e629ca8b487/.tmp/l/2e85311cd5c148c9ab591ce05894ca95 as hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/hbase/acl/6bafa9910cce283c65634e629ca8b487/l/2e85311cd5c148c9ab591ce05894ca95 2023-07-12 22:16:19,494 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 09ad365deca644deb93fb72b3fafa8a3 2023-07-12 22:16:19,494 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2e85311cd5c148c9ab591ce05894ca95 2023-07-12 22:16:19,495 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/hbase/acl/6bafa9910cce283c65634e629ca8b487/l/2e85311cd5c148c9ab591ce05894ca95, entries=7, sequenceid=18, filesize=5.2 K 2023-07-12 22:16:19,496 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for 6bafa9910cce283c65634e629ca8b487 in 133ms, sequenceid=18, compaction requested=false 2023-07-12 22:16:19,501 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/hbase/namespace/e4d70b8a3db9931e0f20d3426a310c90/info/80ca81391854489ab56fe122ddbc906d, entries=2, sequenceid=6, filesize=4.8 K 2023-07-12 22:16:19,502 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for e4d70b8a3db9931e0f20d3426a310c90 in 139ms, sequenceid=6, compaction requested=false 2023-07-12 22:16:19,529 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/hbase/namespace/e4d70b8a3db9931e0f20d3426a310c90/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 22:16:19,529 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/hbase/acl/6bafa9910cce283c65634e629ca8b487/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-07-12 22:16:19,530 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 22:16:19,531 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689200019044.e4d70b8a3db9931e0f20d3426a310c90. 2023-07-12 22:16:19,531 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e4d70b8a3db9931e0f20d3426a310c90: 2023-07-12 22:16:19,531 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 22:16:19,531 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1689200019044.e4d70b8a3db9931e0f20d3426a310c90. 2023-07-12 22:16:19,532 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1689200019921.6bafa9910cce283c65634e629ca8b487. 2023-07-12 22:16:19,533 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 6bafa9910cce283c65634e629ca8b487: 2023-07-12 22:16:19,533 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1689200019921.6bafa9910cce283c65634e629ca8b487. 2023-07-12 22:16:19,547 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/hbase/meta/1588230740/.tmp/rep_barrier/5efbd822482641009999c3a9a93e397b 2023-07-12 22:16:19,552 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5efbd822482641009999c3a9a93e397b 2023-07-12 22:16:19,561 INFO [RS:0;jenkins-hbase4:37349] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,37349,1689200016037; all regions closed. 2023-07-12 22:16:19,562 INFO [RS:2;jenkins-hbase4:34497] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,34497,1689200016186; all regions closed. 2023-07-12 22:16:19,562 DEBUG [RS:1;jenkins-hbase4:40411] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-12 22:16:19,574 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/hbase/meta/1588230740/.tmp/table/244f19c96aae4f36be43c922aba9b755 2023-07-12 22:16:19,581 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 244f19c96aae4f36be43c922aba9b755 2023-07-12 22:16:19,582 DEBUG [RS:2;jenkins-hbase4:34497] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/oldWALs 2023-07-12 22:16:19,582 INFO [RS:2;jenkins-hbase4:34497] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C34497%2C1689200016186:(num 1689200018358) 2023-07-12 22:16:19,582 DEBUG [RS:2;jenkins-hbase4:34497] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 22:16:19,582 INFO [RS:2;jenkins-hbase4:34497] regionserver.LeaseManager(133): Closed leases 2023-07-12 22:16:19,582 INFO [RS:2;jenkins-hbase4:34497] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-12 22:16:19,582 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/hbase/meta/1588230740/.tmp/info/09ad365deca644deb93fb72b3fafa8a3 as hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/hbase/meta/1588230740/info/09ad365deca644deb93fb72b3fafa8a3 2023-07-12 22:16:19,582 INFO [RS:2;jenkins-hbase4:34497] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-12 22:16:19,582 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-12 22:16:19,582 INFO [RS:2;jenkins-hbase4:34497] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-12 22:16:19,583 INFO [RS:2;jenkins-hbase4:34497] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-12 22:16:19,584 INFO [RS:2;jenkins-hbase4:34497] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:34497 2023-07-12 22:16:19,592 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:16:19,593 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-12 22:16:19,593 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:16:19,593 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-12 22:16:19,593 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34497,1689200016186 2023-07-12 22:16:19,593 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-12 22:16:19,593 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-12 22:16:19,594 DEBUG [RS:0;jenkins-hbase4:37349] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/oldWALs 2023-07-12 22:16:19,594 INFO [RS:0;jenkins-hbase4:37349] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C37349%2C1689200016037:(num 1689200018349) 2023-07-12 22:16:19,594 DEBUG [RS:0;jenkins-hbase4:37349] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 22:16:19,594 INFO [RS:0;jenkins-hbase4:37349] regionserver.LeaseManager(133): Closed leases 2023-07-12 22:16:19,594 INFO [RS:0;jenkins-hbase4:37349] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-12 22:16:19,595 INFO [RS:0;jenkins-hbase4:37349] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-12 22:16:19,595 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-12 22:16:19,595 INFO [RS:0;jenkins-hbase4:37349] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-12 22:16:19,595 INFO [RS:0;jenkins-hbase4:37349] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-12 22:16:19,596 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,34497,1689200016186] 2023-07-12 22:16:19,597 INFO [RS:0;jenkins-hbase4:37349] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:37349 2023-07-12 22:16:19,597 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,34497,1689200016186; numProcessing=1 2023-07-12 22:16:19,599 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 09ad365deca644deb93fb72b3fafa8a3 2023-07-12 22:16:19,599 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/hbase/meta/1588230740/info/09ad365deca644deb93fb72b3fafa8a3, entries=48, sequenceid=131, filesize=10.3 K 2023-07-12 22:16:19,599 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:16:19,599 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-12 22:16:19,599 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,34497,1689200016186 already deleted, retry=false 2023-07-12 22:16:19,599 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,34497,1689200016186 expired; onlineServers=2 2023-07-12 22:16:19,600 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,37349,1689200016037 2023-07-12 22:16:19,600 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/hbase/meta/1588230740/.tmp/rep_barrier/5efbd822482641009999c3a9a93e397b as hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/hbase/meta/1588230740/rep_barrier/5efbd822482641009999c3a9a93e397b 2023-07-12 22:16:19,600 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,37349,1689200016037] 2023-07-12 22:16:19,600 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,37349,1689200016037; numProcessing=2 2023-07-12 22:16:19,602 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,37349,1689200016037 already deleted, retry=false 2023-07-12 22:16:19,602 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,37349,1689200016037 expired; onlineServers=1 2023-07-12 22:16:19,606 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5efbd822482641009999c3a9a93e397b 2023-07-12 22:16:19,606 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/hbase/meta/1588230740/rep_barrier/5efbd822482641009999c3a9a93e397b, entries=13, sequenceid=131, filesize=6.4 K 2023-07-12 22:16:19,609 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/hbase/meta/1588230740/.tmp/table/244f19c96aae4f36be43c922aba9b755 as hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/hbase/meta/1588230740/table/244f19c96aae4f36be43c922aba9b755 2023-07-12 22:16:19,616 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 244f19c96aae4f36be43c922aba9b755 2023-07-12 22:16:19,616 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/hbase/meta/1588230740/table/244f19c96aae4f36be43c922aba9b755, entries=24, sequenceid=131, filesize=6.9 K 2023-07-12 22:16:19,617 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 254ms, sequenceid=131, compaction requested=false 2023-07-12 22:16:19,651 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-07-12 22:16:19,652 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 22:16:19,652 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-12 22:16:19,653 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-12 22:16:19,653 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-12 22:16:19,653 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-12 22:16:19,697 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 22:16:19,697 INFO [RS:2;jenkins-hbase4:34497] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,34497,1689200016186; zookeeper connection closed. 2023-07-12 22:16:19,697 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:34497-0x1015b9934320003, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 22:16:19,699 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@73077f0c] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@73077f0c 2023-07-12 22:16:19,762 INFO [RS:1;jenkins-hbase4:40411] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,40411,1689200016125; all regions closed. 2023-07-12 22:16:19,775 DEBUG [RS:1;jenkins-hbase4:40411] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/oldWALs 2023-07-12 22:16:19,775 INFO [RS:1;jenkins-hbase4:40411] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C40411%2C1689200016125.meta:.meta(num 1689200018688) 2023-07-12 22:16:19,788 DEBUG [RS:1;jenkins-hbase4:40411] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/oldWALs 2023-07-12 22:16:19,788 INFO [RS:1;jenkins-hbase4:40411] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C40411%2C1689200016125:(num 1689200018336) 2023-07-12 22:16:19,788 DEBUG [RS:1;jenkins-hbase4:40411] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 22:16:19,788 INFO [RS:1;jenkins-hbase4:40411] regionserver.LeaseManager(133): Closed leases 2023-07-12 22:16:19,788 INFO [RS:1;jenkins-hbase4:40411] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-12 22:16:19,789 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-12 22:16:19,789 INFO [RS:1;jenkins-hbase4:40411] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:40411 2023-07-12 22:16:19,791 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-12 22:16:19,791 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40411,1689200016125 2023-07-12 22:16:19,792 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,40411,1689200016125] 2023-07-12 22:16:19,792 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,40411,1689200016125; numProcessing=3 2023-07-12 22:16:19,793 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,40411,1689200016125 already deleted, retry=false 2023-07-12 22:16:19,793 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,40411,1689200016125 expired; onlineServers=0 2023-07-12 22:16:19,793 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,43225,1689200014499' ***** 2023-07-12 22:16:19,793 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-12 22:16:19,794 DEBUG [M:0;jenkins-hbase4:43225] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@650930c7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-12 22:16:19,794 INFO [M:0;jenkins-hbase4:43225] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,43225,1689200014499 2023-07-12 22:16:19,794 INFO [M:0;jenkins-hbase4:43225] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,43225,1689200014499; all regions closed. 2023-07-12 22:16:19,794 DEBUG [M:0;jenkins-hbase4:43225] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 22:16:19,794 DEBUG [M:0;jenkins-hbase4:43225] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-12 22:16:19,794 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-12 22:16:19,794 DEBUG [M:0;jenkins-hbase4:43225] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-12 22:16:19,794 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689200017826] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689200017826,5,FailOnTimeoutGroup] 2023-07-12 22:16:19,794 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689200017811] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689200017811,5,FailOnTimeoutGroup] 2023-07-12 22:16:19,794 INFO [M:0;jenkins-hbase4:43225] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-12 22:16:19,794 INFO [M:0;jenkins-hbase4:43225] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-12 22:16:19,795 INFO [M:0;jenkins-hbase4:43225] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-07-12 22:16:19,795 DEBUG [M:0;jenkins-hbase4:43225] master.HMaster(1512): Stopping service threads 2023-07-12 22:16:19,795 INFO [M:0;jenkins-hbase4:43225] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-12 22:16:19,795 ERROR [M:0;jenkins-hbase4:43225] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-22,5,PEWorkerGroup] Thread[HFileArchiver-23,5,PEWorkerGroup] 2023-07-12 22:16:19,796 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-12 22:16:19,796 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 22:16:19,796 INFO [M:0;jenkins-hbase4:43225] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-12 22:16:19,796 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-12 22:16:19,796 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-12 22:16:19,796 DEBUG [M:0;jenkins-hbase4:43225] zookeeper.ZKUtil(398): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-12 22:16:19,797 WARN [M:0;jenkins-hbase4:43225] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-12 22:16:19,797 INFO [M:0;jenkins-hbase4:43225] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-12 22:16:19,797 INFO [M:0;jenkins-hbase4:43225] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-12 22:16:19,797 DEBUG [M:0;jenkins-hbase4:43225] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-12 22:16:19,797 INFO [M:0;jenkins-hbase4:43225] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 22:16:19,797 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 22:16:19,797 DEBUG [M:0;jenkins-hbase4:43225] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 22:16:19,798 INFO [RS:0;jenkins-hbase4:37349] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,37349,1689200016037; zookeeper connection closed. 2023-07-12 22:16:19,798 DEBUG [M:0;jenkins-hbase4:43225] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-12 22:16:19,797 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:37349-0x1015b9934320001, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 22:16:19,798 DEBUG [M:0;jenkins-hbase4:43225] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 22:16:19,798 INFO [M:0;jenkins-hbase4:43225] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=375.64 KB heapSize=451.91 KB 2023-07-12 22:16:19,802 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@77a622ab] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@77a622ab 2023-07-12 22:16:19,816 INFO [M:0;jenkins-hbase4:43225] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=375.64 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/8aa222afd6f043fa9bcbec440e454e56 2023-07-12 22:16:19,820 INFO [M:0;jenkins-hbase4:43225] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8aa222afd6f043fa9bcbec440e454e56 2023-07-12 22:16:19,821 DEBUG [M:0;jenkins-hbase4:43225] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/8aa222afd6f043fa9bcbec440e454e56 as hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/8aa222afd6f043fa9bcbec440e454e56 2023-07-12 22:16:19,825 INFO [M:0;jenkins-hbase4:43225] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8aa222afd6f043fa9bcbec440e454e56 2023-07-12 22:16:19,825 INFO [M:0;jenkins-hbase4:43225] regionserver.HStore(1080): Added hdfs://localhost:34335/user/jenkins/test-data/a48e2f7c-9631-30d9-fab1-63861420c967/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/8aa222afd6f043fa9bcbec440e454e56, entries=119, sequenceid=899, filesize=28.6 K 2023-07-12 22:16:19,826 INFO [M:0;jenkins-hbase4:43225] regionserver.HRegion(2948): Finished flush of dataSize ~375.64 KB/384654, heapSize ~451.89 KB/462736, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 28ms, sequenceid=899, compaction requested=false 2023-07-12 22:16:19,828 INFO [M:0;jenkins-hbase4:43225] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 22:16:19,828 DEBUG [M:0;jenkins-hbase4:43225] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-12 22:16:19,832 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-12 22:16:19,832 INFO [M:0;jenkins-hbase4:43225] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-12 22:16:19,833 INFO [M:0;jenkins-hbase4:43225] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:43225 2023-07-12 22:16:19,834 DEBUG [M:0;jenkins-hbase4:43225] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,43225,1689200014499 already deleted, retry=false 2023-07-12 22:16:19,898 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 22:16:19,898 INFO [RS:1;jenkins-hbase4:40411] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,40411,1689200016125; zookeeper connection closed. 2023-07-12 22:16:19,898 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): regionserver:40411-0x1015b9934320002, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 22:16:19,899 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@587e842f] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@587e842f 2023-07-12 22:16:19,900 INFO [Listener at jenkins-hbase4.apache.org/41531] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-07-12 22:16:19,998 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 22:16:19,998 INFO [M:0;jenkins-hbase4:43225] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,43225,1689200014499; zookeeper connection closed. 2023-07-12 22:16:19,998 DEBUG [Listener at localhost/36933-EventThread] zookeeper.ZKWatcher(600): master:43225-0x1015b9934320000, quorum=127.0.0.1:62393, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 22:16:20,000 WARN [Listener at jenkins-hbase4.apache.org/41531] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-12 22:16:20,004 INFO [Listener at jenkins-hbase4.apache.org/41531] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-12 22:16:20,111 WARN [BP-27499011-172.31.14.131-1689200010390 heartbeating to localhost/127.0.0.1:34335] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-12 22:16:20,111 WARN [BP-27499011-172.31.14.131-1689200010390 heartbeating to localhost/127.0.0.1:34335] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-27499011-172.31.14.131-1689200010390 (Datanode Uuid 064d9508-305f-4b36-acef-44974d942e66) service to localhost/127.0.0.1:34335 2023-07-12 22:16:20,113 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/652e6e64-efb3-f860-57fa-f551f44ecb6b/cluster_dcbc62b2-e874-eae0-66ca-6b0e7e7d42e3/dfs/data/data5/current/BP-27499011-172.31.14.131-1689200010390] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-12 22:16:20,114 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/652e6e64-efb3-f860-57fa-f551f44ecb6b/cluster_dcbc62b2-e874-eae0-66ca-6b0e7e7d42e3/dfs/data/data6/current/BP-27499011-172.31.14.131-1689200010390] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-12 22:16:20,116 WARN [Listener at jenkins-hbase4.apache.org/41531] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-12 22:16:20,124 INFO [Listener at jenkins-hbase4.apache.org/41531] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-12 22:16:20,228 WARN [BP-27499011-172.31.14.131-1689200010390 heartbeating to localhost/127.0.0.1:34335] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-12 22:16:20,228 WARN [BP-27499011-172.31.14.131-1689200010390 heartbeating to localhost/127.0.0.1:34335] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-27499011-172.31.14.131-1689200010390 (Datanode Uuid 29fe76f6-e699-49eb-95b3-ecbb62bab1af) service to localhost/127.0.0.1:34335 2023-07-12 22:16:20,229 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/652e6e64-efb3-f860-57fa-f551f44ecb6b/cluster_dcbc62b2-e874-eae0-66ca-6b0e7e7d42e3/dfs/data/data3/current/BP-27499011-172.31.14.131-1689200010390] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-12 22:16:20,229 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/652e6e64-efb3-f860-57fa-f551f44ecb6b/cluster_dcbc62b2-e874-eae0-66ca-6b0e7e7d42e3/dfs/data/data4/current/BP-27499011-172.31.14.131-1689200010390] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-12 22:16:20,231 WARN [Listener at jenkins-hbase4.apache.org/41531] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-12 22:16:20,235 INFO [Listener at jenkins-hbase4.apache.org/41531] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-12 22:16:20,338 WARN [BP-27499011-172.31.14.131-1689200010390 heartbeating to localhost/127.0.0.1:34335] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-12 22:16:20,338 WARN [BP-27499011-172.31.14.131-1689200010390 heartbeating to localhost/127.0.0.1:34335] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-27499011-172.31.14.131-1689200010390 (Datanode Uuid 500b045f-c997-4e4c-aeb0-3d9416bb97ac) service to localhost/127.0.0.1:34335 2023-07-12 22:16:20,339 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/652e6e64-efb3-f860-57fa-f551f44ecb6b/cluster_dcbc62b2-e874-eae0-66ca-6b0e7e7d42e3/dfs/data/data1/current/BP-27499011-172.31.14.131-1689200010390] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-12 22:16:20,340 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/652e6e64-efb3-f860-57fa-f551f44ecb6b/cluster_dcbc62b2-e874-eae0-66ca-6b0e7e7d42e3/dfs/data/data2/current/BP-27499011-172.31.14.131-1689200010390] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-12 22:16:20,372 INFO [Listener at jenkins-hbase4.apache.org/41531] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-12 22:16:20,508 INFO [Listener at jenkins-hbase4.apache.org/41531] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-12 22:16:20,626 INFO [Listener at jenkins-hbase4.apache.org/41531] hbase.HBaseTestingUtility(1293): Minicluster is down