2023-07-13 07:15:34,758 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-07-13 07:15:34,963 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a827846-4542-2630-0c34-c6bc20d13d68 2023-07-13 07:15:34,963 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestSecureExportSnapshot timeout: 13 mins 2023-07-13 07:15:35,000 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-13 07:15:35,181 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-13 07:15:35,182 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a827846-4542-2630-0c34-c6bc20d13d68/cluster_bc2fa478-0401-934d-1612-4dd95a9869a4, deleteOnExit=true 2023-07-13 07:15:35,182 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-13 07:15:35,183 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a827846-4542-2630-0c34-c6bc20d13d68/test.cache.data in system properties and HBase conf 2023-07-13 07:15:35,184 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a827846-4542-2630-0c34-c6bc20d13d68/hadoop.tmp.dir in system properties and HBase conf 2023-07-13 07:15:35,184 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a827846-4542-2630-0c34-c6bc20d13d68/hadoop.log.dir in system properties and HBase conf 2023-07-13 07:15:35,185 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a827846-4542-2630-0c34-c6bc20d13d68/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-13 07:15:35,185 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a827846-4542-2630-0c34-c6bc20d13d68/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-13 07:15:35,185 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-13 07:15:35,443 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-13 07:15:35,449 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a827846-4542-2630-0c34-c6bc20d13d68/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-13 07:15:35,449 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a827846-4542-2630-0c34-c6bc20d13d68/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-13 07:15:35,450 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a827846-4542-2630-0c34-c6bc20d13d68/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-13 07:15:35,450 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a827846-4542-2630-0c34-c6bc20d13d68/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-13 07:15:35,451 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a827846-4542-2630-0c34-c6bc20d13d68/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-13 07:15:35,451 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a827846-4542-2630-0c34-c6bc20d13d68/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-13 07:15:35,452 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a827846-4542-2630-0c34-c6bc20d13d68/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-13 07:15:35,452 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a827846-4542-2630-0c34-c6bc20d13d68/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-13 07:15:35,453 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a827846-4542-2630-0c34-c6bc20d13d68/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-13 07:15:35,453 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a827846-4542-2630-0c34-c6bc20d13d68/nfs.dump.dir in system properties and HBase conf 2023-07-13 07:15:35,453 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a827846-4542-2630-0c34-c6bc20d13d68/java.io.tmpdir in system properties and HBase conf 2023-07-13 07:15:35,454 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a827846-4542-2630-0c34-c6bc20d13d68/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-13 07:15:35,454 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a827846-4542-2630-0c34-c6bc20d13d68/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-13 07:15:35,455 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a827846-4542-2630-0c34-c6bc20d13d68/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-13 07:15:36,038 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-13 07:15:36,042 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-13 07:15:36,316 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-13 07:15:36,499 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-13 07:15:36,532 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-13 07:15:36,573 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-13 07:15:36,605 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a827846-4542-2630-0c34-c6bc20d13d68/java.io.tmpdir/Jetty_localhost_localdomain_38413_hdfs____.1nf239/webapp 2023-07-13 07:15:36,752 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:38413 2023-07-13 07:15:36,764 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-13 07:15:36,765 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-13 07:15:37,316 WARN [Listener at localhost.localdomain/40681] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-13 07:15:37,427 WARN [Listener at localhost.localdomain/40681] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-13 07:15:37,445 WARN [Listener at localhost.localdomain/40681] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-13 07:15:37,453 INFO [Listener at localhost.localdomain/40681] log.Slf4jLog(67): jetty-6.1.26 2023-07-13 07:15:37,458 INFO [Listener at localhost.localdomain/40681] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a827846-4542-2630-0c34-c6bc20d13d68/java.io.tmpdir/Jetty_localhost_42957_datanode____2t4ipw/webapp 2023-07-13 07:15:37,552 INFO [Listener at localhost.localdomain/40681] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42957 2023-07-13 07:15:38,074 WARN [Listener at localhost.localdomain/42625] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-13 07:15:38,116 WARN [Listener at localhost.localdomain/42625] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-13 07:15:38,126 WARN [Listener at localhost.localdomain/42625] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-13 07:15:38,129 INFO [Listener at localhost.localdomain/42625] log.Slf4jLog(67): jetty-6.1.26 2023-07-13 07:15:38,137 INFO [Listener at localhost.localdomain/42625] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a827846-4542-2630-0c34-c6bc20d13d68/java.io.tmpdir/Jetty_localhost_42149_datanode____f3mqe7/webapp 2023-07-13 07:15:38,246 INFO [Listener at localhost.localdomain/42625] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42149 2023-07-13 07:15:38,258 WARN [Listener at localhost.localdomain/35645] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-13 07:15:38,286 WARN [Listener at localhost.localdomain/35645] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-13 07:15:38,289 WARN [Listener at localhost.localdomain/35645] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-13 07:15:38,291 INFO [Listener at localhost.localdomain/35645] log.Slf4jLog(67): jetty-6.1.26 2023-07-13 07:15:38,297 INFO [Listener at localhost.localdomain/35645] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a827846-4542-2630-0c34-c6bc20d13d68/java.io.tmpdir/Jetty_localhost_40845_datanode____ctunms/webapp 2023-07-13 07:15:38,495 INFO [Listener at localhost.localdomain/35645] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40845 2023-07-13 07:15:38,527 WARN [Listener at localhost.localdomain/37489] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-13 07:15:38,815 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x964f7417bfda0ec: Processing first storage report for DS-dd3f8a11-abac-47d1-b0ca-d247a2fa9f44 from datanode 286df2f3-4adc-4591-ab09-d8a23e0418f1 2023-07-13 07:15:38,816 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x964f7417bfda0ec: from storage DS-dd3f8a11-abac-47d1-b0ca-d247a2fa9f44 node DatanodeRegistration(127.0.0.1:34233, datanodeUuid=286df2f3-4adc-4591-ab09-d8a23e0418f1, infoPort=43929, infoSecurePort=0, ipcPort=35645, storageInfo=lv=-57;cid=testClusterID;nsid=1355403765;c=1689232536107), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-07-13 07:15:38,817 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x3906a62dc3826fdf: Processing first storage report for DS-b781829b-0949-4e2e-be72-5c5015b63567 from datanode 79248deb-0320-45b7-a508-b869baa20271 2023-07-13 07:15:38,817 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x3906a62dc3826fdf: from storage DS-b781829b-0949-4e2e-be72-5c5015b63567 node DatanodeRegistration(127.0.0.1:46849, datanodeUuid=79248deb-0320-45b7-a508-b869baa20271, infoPort=36269, infoSecurePort=0, ipcPort=42625, storageInfo=lv=-57;cid=testClusterID;nsid=1355403765;c=1689232536107), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-13 07:15:38,817 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xbdbdc244aed678a0: Processing first storage report for DS-00f0df26-5a1a-4224-a64c-80f7bcd3c8df from datanode 1df9aed5-5032-4715-9b57-f6fb3996a0e6 2023-07-13 07:15:38,818 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xbdbdc244aed678a0: from storage DS-00f0df26-5a1a-4224-a64c-80f7bcd3c8df node DatanodeRegistration(127.0.0.1:45545, datanodeUuid=1df9aed5-5032-4715-9b57-f6fb3996a0e6, infoPort=37561, infoSecurePort=0, ipcPort=37489, storageInfo=lv=-57;cid=testClusterID;nsid=1355403765;c=1689232536107), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-13 07:15:38,818 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x964f7417bfda0ec: Processing first storage report for DS-953374e1-c965-4ffa-acfc-048694d478d3 from datanode 286df2f3-4adc-4591-ab09-d8a23e0418f1 2023-07-13 07:15:38,818 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x964f7417bfda0ec: from storage DS-953374e1-c965-4ffa-acfc-048694d478d3 node DatanodeRegistration(127.0.0.1:34233, datanodeUuid=286df2f3-4adc-4591-ab09-d8a23e0418f1, infoPort=43929, infoSecurePort=0, ipcPort=35645, storageInfo=lv=-57;cid=testClusterID;nsid=1355403765;c=1689232536107), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-13 07:15:38,818 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x3906a62dc3826fdf: Processing first storage report for DS-7107d93b-3815-4750-927d-bceeee15033d from datanode 79248deb-0320-45b7-a508-b869baa20271 2023-07-13 07:15:38,818 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x3906a62dc3826fdf: from storage DS-7107d93b-3815-4750-927d-bceeee15033d node DatanodeRegistration(127.0.0.1:46849, datanodeUuid=79248deb-0320-45b7-a508-b869baa20271, infoPort=36269, infoSecurePort=0, ipcPort=42625, storageInfo=lv=-57;cid=testClusterID;nsid=1355403765;c=1689232536107), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-13 07:15:38,819 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xbdbdc244aed678a0: Processing first storage report for DS-8c6e9410-6cf1-4344-ad4a-941159f77143 from datanode 1df9aed5-5032-4715-9b57-f6fb3996a0e6 2023-07-13 07:15:38,819 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xbdbdc244aed678a0: from storage DS-8c6e9410-6cf1-4344-ad4a-941159f77143 node DatanodeRegistration(127.0.0.1:45545, datanodeUuid=1df9aed5-5032-4715-9b57-f6fb3996a0e6, infoPort=37561, infoSecurePort=0, ipcPort=37489, storageInfo=lv=-57;cid=testClusterID;nsid=1355403765;c=1689232536107), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-13 07:15:39,128 DEBUG [Listener at localhost.localdomain/37489] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a827846-4542-2630-0c34-c6bc20d13d68 2023-07-13 07:15:39,240 INFO [Listener at localhost.localdomain/37489] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a827846-4542-2630-0c34-c6bc20d13d68/cluster_bc2fa478-0401-934d-1612-4dd95a9869a4/zookeeper_0, clientPort=58099, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a827846-4542-2630-0c34-c6bc20d13d68/cluster_bc2fa478-0401-934d-1612-4dd95a9869a4/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a827846-4542-2630-0c34-c6bc20d13d68/cluster_bc2fa478-0401-934d-1612-4dd95a9869a4/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-13 07:15:39,296 INFO [Listener at localhost.localdomain/37489] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=58099 2023-07-13 07:15:39,319 INFO [Listener at localhost.localdomain/37489] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-13 07:15:39,322 INFO [Listener at localhost.localdomain/37489] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-13 07:15:40,089 INFO [Listener at localhost.localdomain/37489] util.FSUtils(471): Created version file at hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e with version=8 2023-07-13 07:15:40,089 INFO [Listener at localhost.localdomain/37489] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/hbase-staging 2023-07-13 07:15:40,421 INFO [Listener at localhost.localdomain/37489] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-13 07:15:40,879 INFO [Listener at localhost.localdomain/37489] client.ConnectionUtils(127): master/jenkins-hbase20:0 server-side Connection retries=45 2023-07-13 07:15:40,907 INFO [Listener at localhost.localdomain/37489] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-13 07:15:40,908 INFO [Listener at localhost.localdomain/37489] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-13 07:15:40,908 INFO [Listener at localhost.localdomain/37489] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-13 07:15:40,908 INFO [Listener at localhost.localdomain/37489] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-13 07:15:40,908 INFO [Listener at localhost.localdomain/37489] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-13 07:15:41,034 INFO [Listener at localhost.localdomain/37489] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-13 07:15:41,098 DEBUG [Listener at localhost.localdomain/37489] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-13 07:15:41,181 INFO [Listener at localhost.localdomain/37489] ipc.NettyRpcServer(120): Bind to /148.251.75.209:37475 2023-07-13 07:15:41,192 INFO [Listener at localhost.localdomain/37489] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-13 07:15:41,194 INFO [Listener at localhost.localdomain/37489] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-13 07:15:41,213 INFO [Listener at localhost.localdomain/37489] zookeeper.RecoverableZooKeeper(93): Process identifier=master:37475 connecting to ZooKeeper ensemble=127.0.0.1:58099 2023-07-13 07:15:41,252 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:374750x0, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-13 07:15:41,256 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:37475-0x100852f7ac90000 connected 2023-07-13 07:15:41,304 DEBUG [Listener at localhost.localdomain/37489] zookeeper.ZKUtil(164): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-13 07:15:41,305 DEBUG [Listener at localhost.localdomain/37489] zookeeper.ZKUtil(164): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-13 07:15:41,322 DEBUG [Listener at localhost.localdomain/37489] zookeeper.ZKUtil(164): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-13 07:15:41,332 DEBUG [Listener at localhost.localdomain/37489] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=37475 2023-07-13 07:15:41,334 DEBUG [Listener at localhost.localdomain/37489] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=37475 2023-07-13 07:15:41,336 DEBUG [Listener at localhost.localdomain/37489] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=37475 2023-07-13 07:15:41,336 DEBUG [Listener at localhost.localdomain/37489] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=37475 2023-07-13 07:15:41,337 DEBUG [Listener at localhost.localdomain/37489] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=37475 2023-07-13 07:15:41,344 INFO [Listener at localhost.localdomain/37489] master.HMaster(444): hbase.rootdir=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e, hbase.cluster.distributed=false 2023-07-13 07:15:41,408 INFO [Listener at localhost.localdomain/37489] client.ConnectionUtils(127): regionserver/jenkins-hbase20:0 server-side Connection retries=45 2023-07-13 07:15:41,408 INFO [Listener at localhost.localdomain/37489] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-13 07:15:41,408 INFO [Listener at localhost.localdomain/37489] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-13 07:15:41,409 INFO [Listener at localhost.localdomain/37489] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-13 07:15:41,409 INFO [Listener at localhost.localdomain/37489] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-13 07:15:41,409 INFO [Listener at localhost.localdomain/37489] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-13 07:15:41,413 INFO [Listener at localhost.localdomain/37489] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-13 07:15:41,417 INFO [Listener at localhost.localdomain/37489] ipc.NettyRpcServer(120): Bind to /148.251.75.209:42807 2023-07-13 07:15:41,419 INFO [Listener at localhost.localdomain/37489] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-13 07:15:41,426 DEBUG [Listener at localhost.localdomain/37489] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-13 07:15:41,428 INFO [Listener at localhost.localdomain/37489] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-13 07:15:41,430 INFO [Listener at localhost.localdomain/37489] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-13 07:15:41,432 INFO [Listener at localhost.localdomain/37489] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:42807 connecting to ZooKeeper ensemble=127.0.0.1:58099 2023-07-13 07:15:41,437 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:428070x0, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-13 07:15:41,438 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:42807-0x100852f7ac90001 connected 2023-07-13 07:15:41,438 DEBUG [Listener at localhost.localdomain/37489] zookeeper.ZKUtil(164): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-13 07:15:41,440 DEBUG [Listener at localhost.localdomain/37489] zookeeper.ZKUtil(164): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-13 07:15:41,441 DEBUG [Listener at localhost.localdomain/37489] zookeeper.ZKUtil(164): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-13 07:15:41,441 DEBUG [Listener at localhost.localdomain/37489] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=42807 2023-07-13 07:15:41,442 DEBUG [Listener at localhost.localdomain/37489] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=42807 2023-07-13 07:15:41,447 DEBUG [Listener at localhost.localdomain/37489] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=42807 2023-07-13 07:15:41,447 DEBUG [Listener at localhost.localdomain/37489] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42807 2023-07-13 07:15:41,447 DEBUG [Listener at localhost.localdomain/37489] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=42807 2023-07-13 07:15:41,464 INFO [Listener at localhost.localdomain/37489] client.ConnectionUtils(127): regionserver/jenkins-hbase20:0 server-side Connection retries=45 2023-07-13 07:15:41,464 INFO [Listener at localhost.localdomain/37489] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-13 07:15:41,465 INFO [Listener at localhost.localdomain/37489] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-13 07:15:41,466 INFO [Listener at localhost.localdomain/37489] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-13 07:15:41,466 INFO [Listener at localhost.localdomain/37489] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-13 07:15:41,466 INFO [Listener at localhost.localdomain/37489] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-13 07:15:41,466 INFO [Listener at localhost.localdomain/37489] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-13 07:15:41,468 INFO [Listener at localhost.localdomain/37489] ipc.NettyRpcServer(120): Bind to /148.251.75.209:44195 2023-07-13 07:15:41,469 INFO [Listener at localhost.localdomain/37489] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-13 07:15:41,470 DEBUG [Listener at localhost.localdomain/37489] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-13 07:15:41,471 INFO [Listener at localhost.localdomain/37489] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-13 07:15:41,475 INFO [Listener at localhost.localdomain/37489] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-13 07:15:41,477 INFO [Listener at localhost.localdomain/37489] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:44195 connecting to ZooKeeper ensemble=127.0.0.1:58099 2023-07-13 07:15:41,481 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:441950x0, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-13 07:15:41,482 DEBUG [Listener at localhost.localdomain/37489] zookeeper.ZKUtil(164): regionserver:441950x0, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-13 07:15:41,483 DEBUG [Listener at localhost.localdomain/37489] zookeeper.ZKUtil(164): regionserver:441950x0, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-13 07:15:41,484 DEBUG [Listener at localhost.localdomain/37489] zookeeper.ZKUtil(164): regionserver:441950x0, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-13 07:15:41,487 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:44195-0x100852f7ac90002 connected 2023-07-13 07:15:41,487 DEBUG [Listener at localhost.localdomain/37489] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44195 2023-07-13 07:15:41,488 DEBUG [Listener at localhost.localdomain/37489] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44195 2023-07-13 07:15:41,488 DEBUG [Listener at localhost.localdomain/37489] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44195 2023-07-13 07:15:41,491 DEBUG [Listener at localhost.localdomain/37489] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44195 2023-07-13 07:15:41,494 DEBUG [Listener at localhost.localdomain/37489] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44195 2023-07-13 07:15:41,504 INFO [Listener at localhost.localdomain/37489] client.ConnectionUtils(127): regionserver/jenkins-hbase20:0 server-side Connection retries=45 2023-07-13 07:15:41,505 INFO [Listener at localhost.localdomain/37489] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-13 07:15:41,505 INFO [Listener at localhost.localdomain/37489] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-13 07:15:41,505 INFO [Listener at localhost.localdomain/37489] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-13 07:15:41,505 INFO [Listener at localhost.localdomain/37489] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-13 07:15:41,506 INFO [Listener at localhost.localdomain/37489] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-13 07:15:41,506 INFO [Listener at localhost.localdomain/37489] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-13 07:15:41,508 INFO [Listener at localhost.localdomain/37489] ipc.NettyRpcServer(120): Bind to /148.251.75.209:44607 2023-07-13 07:15:41,508 INFO [Listener at localhost.localdomain/37489] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-13 07:15:41,509 DEBUG [Listener at localhost.localdomain/37489] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-13 07:15:41,510 INFO [Listener at localhost.localdomain/37489] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-13 07:15:41,512 INFO [Listener at localhost.localdomain/37489] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-13 07:15:41,513 INFO [Listener at localhost.localdomain/37489] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:44607 connecting to ZooKeeper ensemble=127.0.0.1:58099 2023-07-13 07:15:41,517 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:446070x0, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-13 07:15:41,518 DEBUG [Listener at localhost.localdomain/37489] zookeeper.ZKUtil(164): regionserver:446070x0, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-13 07:15:41,519 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:44607-0x100852f7ac90003 connected 2023-07-13 07:15:41,519 DEBUG [Listener at localhost.localdomain/37489] zookeeper.ZKUtil(164): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-13 07:15:41,520 DEBUG [Listener at localhost.localdomain/37489] zookeeper.ZKUtil(164): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-13 07:15:41,526 DEBUG [Listener at localhost.localdomain/37489] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44607 2023-07-13 07:15:41,526 DEBUG [Listener at localhost.localdomain/37489] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44607 2023-07-13 07:15:41,526 DEBUG [Listener at localhost.localdomain/37489] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44607 2023-07-13 07:15:41,527 DEBUG [Listener at localhost.localdomain/37489] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44607 2023-07-13 07:15:41,528 DEBUG [Listener at localhost.localdomain/37489] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44607 2023-07-13 07:15:41,532 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase20.apache.org,37475,1689232540263 2023-07-13 07:15:41,542 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-13 07:15:41,543 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase20.apache.org,37475,1689232540263 2023-07-13 07:15:41,563 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-13 07:15:41,563 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-13 07:15:41,563 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-13 07:15:41,563 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-13 07:15:41,563 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-13 07:15:41,566 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-13 07:15:41,566 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-13 07:15:41,568 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase20.apache.org,37475,1689232540263 from backup master directory 2023-07-13 07:15:41,575 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase20.apache.org,37475,1689232540263 2023-07-13 07:15:41,576 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-13 07:15:41,577 WARN [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-13 07:15:41,577 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase20.apache.org,37475,1689232540263 2023-07-13 07:15:41,581 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-13 07:15:41,583 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-13 07:15:41,690 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/hbase.id with ID: 4acf9257-98cd-49f2-812b-51d8a35539de 2023-07-13 07:15:41,773 INFO [master/jenkins-hbase20:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-13 07:15:41,791 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-13 07:15:41,845 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x5b63f268 to 127.0.0.1:58099 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-13 07:15:41,876 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4d348a1d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-13 07:15:41,900 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-13 07:15:41,901 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-13 07:15:41,917 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-13 07:15:41,918 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-13 07:15:41,919 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-13 07:15:41,924 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-13 07:15:41,925 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-13 07:15:41,962 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/MasterData/data/master/store-tmp 2023-07-13 07:15:42,037 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 07:15:42,037 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-13 07:15:42,037 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-13 07:15:42,038 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-13 07:15:42,038 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-13 07:15:42,038 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-13 07:15:42,038 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-13 07:15:42,038 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-13 07:15:42,040 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/MasterData/WALs/jenkins-hbase20.apache.org,37475,1689232540263 2023-07-13 07:15:42,075 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C37475%2C1689232540263, suffix=, logDir=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/MasterData/WALs/jenkins-hbase20.apache.org,37475,1689232540263, archiveDir=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/MasterData/oldWALs, maxLogs=10 2023-07-13 07:15:42,151 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46849,DS-b781829b-0949-4e2e-be72-5c5015b63567,DISK] 2023-07-13 07:15:42,152 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45545,DS-00f0df26-5a1a-4224-a64c-80f7bcd3c8df,DISK] 2023-07-13 07:15:42,151 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34233,DS-dd3f8a11-abac-47d1-b0ca-d247a2fa9f44,DISK] 2023-07-13 07:15:42,163 DEBUG [RS-EventLoopGroup-5-1] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-13 07:15:42,238 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/MasterData/WALs/jenkins-hbase20.apache.org,37475,1689232540263/jenkins-hbase20.apache.org%2C37475%2C1689232540263.1689232542088 2023-07-13 07:15:42,239 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45545,DS-00f0df26-5a1a-4224-a64c-80f7bcd3c8df,DISK], DatanodeInfoWithStorage[127.0.0.1:46849,DS-b781829b-0949-4e2e-be72-5c5015b63567,DISK], DatanodeInfoWithStorage[127.0.0.1:34233,DS-dd3f8a11-abac-47d1-b0ca-d247a2fa9f44,DISK]] 2023-07-13 07:15:42,240 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-13 07:15:42,240 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 07:15:42,244 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-13 07:15:42,246 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-13 07:15:42,329 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-13 07:15:42,337 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-13 07:15:42,367 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-13 07:15:42,382 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-13 07:15:42,388 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-13 07:15:42,390 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-13 07:15:42,406 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-13 07:15:42,411 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-13 07:15:42,414 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63631692, jitterRate=-0.05181390047073364}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-13 07:15:42,414 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-13 07:15:42,416 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-13 07:15:42,439 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-13 07:15:42,439 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-13 07:15:42,442 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-13 07:15:42,444 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-13 07:15:42,474 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 30 msec 2023-07-13 07:15:42,475 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-13 07:15:42,504 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-13 07:15:42,510 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-13 07:15:42,533 INFO [master/jenkins-hbase20:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-13 07:15:42,537 INFO [master/jenkins-hbase20:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-13 07:15:42,538 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-13 07:15:42,544 INFO [master/jenkins-hbase20:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-13 07:15:42,548 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-13 07:15:42,552 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-13 07:15:42,554 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-13 07:15:42,554 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-13 07:15:42,569 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-13 07:15:42,575 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-13 07:15:42,575 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-13 07:15:42,575 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-13 07:15:42,575 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-13 07:15:42,575 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-13 07:15:42,576 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase20.apache.org,37475,1689232540263, sessionid=0x100852f7ac90000, setting cluster-up flag (Was=false) 2023-07-13 07:15:42,593 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-13 07:15:42,597 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-13 07:15:42,599 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase20.apache.org,37475,1689232540263 2023-07-13 07:15:42,608 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-13 07:15:42,613 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-13 07:15:42,616 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase20.apache.org,37475,1689232540263 2023-07-13 07:15:42,619 WARN [master/jenkins-hbase20:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.hbase-snapshot/.tmp 2023-07-13 07:15:42,636 INFO [RS:2;jenkins-hbase20:44607] regionserver.HRegionServer(951): ClusterId : 4acf9257-98cd-49f2-812b-51d8a35539de 2023-07-13 07:15:42,637 INFO [RS:1;jenkins-hbase20:44195] regionserver.HRegionServer(951): ClusterId : 4acf9257-98cd-49f2-812b-51d8a35539de 2023-07-13 07:15:42,639 INFO [RS:0;jenkins-hbase20:42807] regionserver.HRegionServer(951): ClusterId : 4acf9257-98cd-49f2-812b-51d8a35539de 2023-07-13 07:15:42,644 DEBUG [RS:1;jenkins-hbase20:44195] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-13 07:15:42,644 DEBUG [RS:0;jenkins-hbase20:42807] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-13 07:15:42,644 DEBUG [RS:2;jenkins-hbase20:44607] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-13 07:15:42,650 DEBUG [RS:1;jenkins-hbase20:44195] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-13 07:15:42,650 DEBUG [RS:0;jenkins-hbase20:42807] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-13 07:15:42,650 DEBUG [RS:2;jenkins-hbase20:44607] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-13 07:15:42,650 DEBUG [RS:0;jenkins-hbase20:42807] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-13 07:15:42,650 DEBUG [RS:1;jenkins-hbase20:44195] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-13 07:15:42,650 DEBUG [RS:2;jenkins-hbase20:44607] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-13 07:15:42,653 DEBUG [RS:1;jenkins-hbase20:44195] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-13 07:15:42,653 DEBUG [RS:0;jenkins-hbase20:42807] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-13 07:15:42,656 DEBUG [RS:1;jenkins-hbase20:44195] zookeeper.ReadOnlyZKClient(139): Connect 0x26926280 to 127.0.0.1:58099 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-13 07:15:42,656 DEBUG [RS:2;jenkins-hbase20:44607] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-13 07:15:42,656 DEBUG [RS:0;jenkins-hbase20:42807] zookeeper.ReadOnlyZKClient(139): Connect 0x0fa2ec23 to 127.0.0.1:58099 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-13 07:15:42,670 DEBUG [RS:2;jenkins-hbase20:44607] zookeeper.ReadOnlyZKClient(139): Connect 0x3c1664ca to 127.0.0.1:58099 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-13 07:15:42,677 DEBUG [RS:1;jenkins-hbase20:44195] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7ec80651, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-13 07:15:42,678 DEBUG [RS:1;jenkins-hbase20:44195] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2687f3b2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-07-13 07:15:42,689 DEBUG [RS:0;jenkins-hbase20:42807] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@73755a34, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-13 07:15:42,690 DEBUG [RS:0;jenkins-hbase20:42807] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7ce008e3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-07-13 07:15:42,722 DEBUG [RS:0;jenkins-hbase20:42807] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase20:42807 2023-07-13 07:15:42,722 DEBUG [RS:1;jenkins-hbase20:44195] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase20:44195 2023-07-13 07:15:42,723 DEBUG [RS:2;jenkins-hbase20:44607] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7914ed2c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-13 07:15:42,724 DEBUG [RS:2;jenkins-hbase20:44607] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3f41ae6b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-07-13 07:15:42,728 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-07-13 07:15:42,729 INFO [RS:1;jenkins-hbase20:44195] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-13 07:15:42,734 INFO [master/jenkins-hbase20:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-13 07:15:42,729 INFO [RS:0;jenkins-hbase20:42807] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-13 07:15:42,734 INFO [RS:1;jenkins-hbase20:44195] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-13 07:15:42,734 INFO [RS:0;jenkins-hbase20:42807] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-13 07:15:42,734 INFO [master/jenkins-hbase20:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-07-13 07:15:42,734 DEBUG [RS:1;jenkins-hbase20:44195] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-13 07:15:42,734 DEBUG [RS:0;jenkins-hbase20:42807] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-13 07:15:42,735 INFO [RS:1;jenkins-hbase20:44195] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-13 07:15:42,736 INFO [RS:0;jenkins-hbase20:42807] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-13 07:15:42,736 DEBUG [RS:1;jenkins-hbase20:44195] regionserver.HRegionServer(1022): About to register with Master. 2023-07-13 07:15:42,736 DEBUG [RS:0;jenkins-hbase20:42807] regionserver.HRegionServer(1022): About to register with Master. 2023-07-13 07:15:42,739 DEBUG [RS:2;jenkins-hbase20:44607] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase20:44607 2023-07-13 07:15:42,739 INFO [RS:2;jenkins-hbase20:44607] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-13 07:15:42,739 INFO [RS:2;jenkins-hbase20:44607] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-13 07:15:42,739 DEBUG [RS:2;jenkins-hbase20:44607] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-13 07:15:42,739 INFO [RS:2;jenkins-hbase20:44607] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-13 07:15:42,739 INFO [RS:1;jenkins-hbase20:44195] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase20.apache.org,37475,1689232540263 with isa=jenkins-hbase20.apache.org/148.251.75.209:44195, startcode=1689232541463 2023-07-13 07:15:42,740 DEBUG [RS:2;jenkins-hbase20:44607] regionserver.HRegionServer(1022): About to register with Master. 2023-07-13 07:15:42,741 INFO [RS:0;jenkins-hbase20:42807] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase20.apache.org,37475,1689232540263 with isa=jenkins-hbase20.apache.org/148.251.75.209:42807, startcode=1689232541407 2023-07-13 07:15:42,741 INFO [RS:2;jenkins-hbase20:44607] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase20.apache.org,37475,1689232540263 with isa=jenkins-hbase20.apache.org/148.251.75.209:44607, startcode=1689232541504 2023-07-13 07:15:42,759 DEBUG [RS:1;jenkins-hbase20:44195] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-13 07:15:42,760 DEBUG [RS:0;jenkins-hbase20:42807] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-13 07:15:42,760 DEBUG [RS:2;jenkins-hbase20:44607] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-13 07:15:42,819 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:55319, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-07-13 07:15:42,819 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:40747, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-13 07:15:42,820 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:34345, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-07-13 07:15:42,830 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37475] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-13 07:15:42,830 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-13 07:15:42,839 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-07-13 07:15:42,839 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-07-13 07:15:42,839 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-07-13 07:15:42,840 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-07-13 07:15:42,840 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase20:0, corePoolSize=10, maxPoolSize=10 2023-07-13 07:15:42,840 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-13 07:15:42,840 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-07-13 07:15:42,840 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-13 07:15:42,841 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37475] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-13 07:15:42,842 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37475] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-13 07:15:42,848 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689232572847 2023-07-13 07:15:42,850 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-13 07:15:42,876 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-13 07:15:42,878 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-13 07:15:42,878 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-13 07:15:42,882 DEBUG [RS:0;jenkins-hbase20:42807] regionserver.HRegionServer(2830): Master is not running yet 2023-07-13 07:15:42,882 DEBUG [RS:1;jenkins-hbase20:44195] regionserver.HRegionServer(2830): Master is not running yet 2023-07-13 07:15:42,883 WARN [RS:0;jenkins-hbase20:42807] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-13 07:15:42,883 WARN [RS:1;jenkins-hbase20:44195] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-13 07:15:42,883 DEBUG [RS:2;jenkins-hbase20:44607] regionserver.HRegionServer(2830): Master is not running yet 2023-07-13 07:15:42,883 WARN [RS:2;jenkins-hbase20:44607] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-13 07:15:42,884 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-13 07:15:42,885 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-13 07:15:42,885 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-13 07:15:42,885 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-13 07:15:42,885 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-13 07:15:42,895 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-13 07:15:42,901 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-13 07:15:42,903 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-13 07:15:42,903 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-13 07:15:42,907 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-13 07:15:42,907 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-13 07:15:42,909 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1689232542909,5,FailOnTimeoutGroup] 2023-07-13 07:15:42,910 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1689232542909,5,FailOnTimeoutGroup] 2023-07-13 07:15:42,910 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-13 07:15:42,911 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-13 07:15:42,912 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-13 07:15:42,912 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-13 07:15:42,938 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-13 07:15:42,940 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-13 07:15:42,940 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e 2023-07-13 07:15:42,973 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 07:15:42,975 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-13 07:15:42,979 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/hbase/meta/1588230740/info 2023-07-13 07:15:42,980 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-13 07:15:42,983 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-13 07:15:42,983 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-13 07:15:42,984 INFO [RS:1;jenkins-hbase20:44195] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase20.apache.org,37475,1689232540263 with isa=jenkins-hbase20.apache.org/148.251.75.209:44195, startcode=1689232541463 2023-07-13 07:15:42,984 INFO [RS:2;jenkins-hbase20:44607] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase20.apache.org,37475,1689232540263 with isa=jenkins-hbase20.apache.org/148.251.75.209:44607, startcode=1689232541504 2023-07-13 07:15:42,984 INFO [RS:0;jenkins-hbase20:42807] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase20.apache.org,37475,1689232540263 with isa=jenkins-hbase20.apache.org/148.251.75.209:42807, startcode=1689232541407 2023-07-13 07:15:42,987 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/hbase/meta/1588230740/rep_barrier 2023-07-13 07:15:42,988 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-13 07:15:42,989 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-13 07:15:42,989 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-13 07:15:42,991 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37475] master.ServerManager(394): Registering regionserver=jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:15:42,993 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/hbase/meta/1588230740/table 2023-07-13 07:15:42,993 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-13 07:15:42,995 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-13 07:15:42,997 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/hbase/meta/1588230740 2023-07-13 07:15:42,998 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/hbase/meta/1588230740 2023-07-13 07:15:43,000 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37475] master.ServerManager(394): Registering regionserver=jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:15:43,001 DEBUG [RS:0;jenkins-hbase20:42807] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e 2023-07-13 07:15:43,001 DEBUG [RS:0;jenkins-hbase20:42807] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost.localdomain:40681 2023-07-13 07:15:43,001 DEBUG [RS:0;jenkins-hbase20:42807] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-13 07:15:43,005 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-13 07:15:43,007 DEBUG [RS:1;jenkins-hbase20:44195] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e 2023-07-13 07:15:43,007 DEBUG [RS:1;jenkins-hbase20:44195] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost.localdomain:40681 2023-07-13 07:15:43,007 DEBUG [RS:1;jenkins-hbase20:44195] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-13 07:15:43,007 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37475] master.ServerManager(394): Registering regionserver=jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:15:43,010 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-13 07:15:43,011 DEBUG [RS:0;jenkins-hbase20:42807] zookeeper.ZKUtil(162): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:15:43,011 WARN [RS:0;jenkins-hbase20:42807] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-13 07:15:43,012 INFO [RS:0;jenkins-hbase20:42807] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-13 07:15:43,012 DEBUG [RS:0;jenkins-hbase20:42807] regionserver.HRegionServer(1948): logDir=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/WALs/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:15:43,017 DEBUG [RS:1;jenkins-hbase20:44195] zookeeper.ZKUtil(162): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:15:43,027 DEBUG [RS:2;jenkins-hbase20:44607] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e 2023-07-13 07:15:43,018 WARN [RS:1;jenkins-hbase20:44195] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-13 07:15:43,028 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-13 07:15:43,028 INFO [RS:1;jenkins-hbase20:44195] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-13 07:15:43,027 DEBUG [RS:2;jenkins-hbase20:44607] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost.localdomain:40681 2023-07-13 07:15:43,030 DEBUG [RS:2;jenkins-hbase20:44607] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-13 07:15:43,029 DEBUG [RS:1;jenkins-hbase20:44195] regionserver.HRegionServer(1948): logDir=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/WALs/jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:15:43,030 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase20.apache.org,42807,1689232541407] 2023-07-13 07:15:43,031 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase20.apache.org,44195,1689232541463] 2023-07-13 07:15:43,032 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-13 07:15:43,033 DEBUG [RS:2;jenkins-hbase20:44607] zookeeper.ZKUtil(162): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:15:43,033 WARN [RS:2;jenkins-hbase20:44607] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-13 07:15:43,033 INFO [RS:2;jenkins-hbase20:44607] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-13 07:15:43,034 DEBUG [RS:2;jenkins-hbase20:44607] regionserver.HRegionServer(1948): logDir=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/WALs/jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:15:43,043 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase20.apache.org,44607,1689232541504] 2023-07-13 07:15:43,050 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-13 07:15:43,051 DEBUG [RS:0;jenkins-hbase20:42807] zookeeper.ZKUtil(162): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:15:43,051 DEBUG [RS:0;jenkins-hbase20:42807] zookeeper.ZKUtil(162): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:15:43,052 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70575991, jitterRate=0.05166421830654144}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-13 07:15:43,052 DEBUG [RS:1;jenkins-hbase20:44195] zookeeper.ZKUtil(162): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:15:43,052 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-13 07:15:43,052 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-13 07:15:43,052 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-13 07:15:43,052 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-13 07:15:43,052 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-13 07:15:43,052 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-13 07:15:43,053 DEBUG [RS:0;jenkins-hbase20:42807] zookeeper.ZKUtil(162): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:15:43,053 DEBUG [RS:2;jenkins-hbase20:44607] zookeeper.ZKUtil(162): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:15:43,053 DEBUG [RS:1;jenkins-hbase20:44195] zookeeper.ZKUtil(162): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:15:43,055 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-13 07:15:43,055 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-13 07:15:43,055 DEBUG [RS:1;jenkins-hbase20:44195] zookeeper.ZKUtil(162): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:15:43,055 DEBUG [RS:2;jenkins-hbase20:44607] zookeeper.ZKUtil(162): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:15:43,056 DEBUG [RS:2;jenkins-hbase20:44607] zookeeper.ZKUtil(162): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:15:43,063 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-13 07:15:43,063 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-13 07:15:43,070 DEBUG [RS:0;jenkins-hbase20:42807] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-13 07:15:43,070 DEBUG [RS:2;jenkins-hbase20:44607] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-13 07:15:43,070 DEBUG [RS:1;jenkins-hbase20:44195] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-13 07:15:43,081 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-13 07:15:43,083 INFO [RS:1;jenkins-hbase20:44195] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-13 07:15:43,083 INFO [RS:2;jenkins-hbase20:44607] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-13 07:15:43,083 INFO [RS:0;jenkins-hbase20:42807] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-13 07:15:43,098 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-13 07:15:43,106 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-13 07:15:43,118 INFO [RS:0;jenkins-hbase20:42807] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-13 07:15:43,118 INFO [RS:1;jenkins-hbase20:44195] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-13 07:15:43,118 INFO [RS:2;jenkins-hbase20:44607] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-13 07:15:43,123 INFO [RS:0;jenkins-hbase20:42807] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-13 07:15:43,123 INFO [RS:1;jenkins-hbase20:44195] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-13 07:15:43,123 INFO [RS:2;jenkins-hbase20:44607] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-13 07:15:43,124 INFO [RS:1;jenkins-hbase20:44195] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-13 07:15:43,123 INFO [RS:0;jenkins-hbase20:42807] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-13 07:15:43,124 INFO [RS:2;jenkins-hbase20:44607] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-13 07:15:43,126 INFO [RS:2;jenkins-hbase20:44607] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-13 07:15:43,126 INFO [RS:0;jenkins-hbase20:42807] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-13 07:15:43,126 INFO [RS:1;jenkins-hbase20:44195] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-13 07:15:43,136 INFO [RS:2;jenkins-hbase20:44607] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-13 07:15:43,136 INFO [RS:0;jenkins-hbase20:42807] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-13 07:15:43,136 INFO [RS:1;jenkins-hbase20:44195] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-13 07:15:43,137 DEBUG [RS:2;jenkins-hbase20:44607] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-13 07:15:43,137 DEBUG [RS:0;jenkins-hbase20:42807] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-13 07:15:43,138 DEBUG [RS:2;jenkins-hbase20:44607] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-13 07:15:43,137 DEBUG [RS:1;jenkins-hbase20:44195] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-13 07:15:43,138 DEBUG [RS:2;jenkins-hbase20:44607] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-13 07:15:43,138 DEBUG [RS:0;jenkins-hbase20:42807] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-13 07:15:43,138 DEBUG [RS:2;jenkins-hbase20:44607] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-13 07:15:43,138 DEBUG [RS:1;jenkins-hbase20:44195] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-13 07:15:43,138 DEBUG [RS:2;jenkins-hbase20:44607] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-13 07:15:43,138 DEBUG [RS:0;jenkins-hbase20:42807] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-13 07:15:43,138 DEBUG [RS:2;jenkins-hbase20:44607] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-07-13 07:15:43,138 DEBUG [RS:1;jenkins-hbase20:44195] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-13 07:15:43,138 DEBUG [RS:2;jenkins-hbase20:44607] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-13 07:15:43,138 DEBUG [RS:0;jenkins-hbase20:42807] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-13 07:15:43,138 DEBUG [RS:1;jenkins-hbase20:44195] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-13 07:15:43,138 DEBUG [RS:0;jenkins-hbase20:42807] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-13 07:15:43,138 DEBUG [RS:2;jenkins-hbase20:44607] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-13 07:15:43,139 DEBUG [RS:0;jenkins-hbase20:42807] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-07-13 07:15:43,139 DEBUG [RS:2;jenkins-hbase20:44607] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-13 07:15:43,139 DEBUG [RS:0;jenkins-hbase20:42807] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-13 07:15:43,139 DEBUG [RS:2;jenkins-hbase20:44607] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-13 07:15:43,139 DEBUG [RS:0;jenkins-hbase20:42807] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-13 07:15:43,139 DEBUG [RS:1;jenkins-hbase20:44195] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-13 07:15:43,139 DEBUG [RS:0;jenkins-hbase20:42807] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-13 07:15:43,139 DEBUG [RS:1;jenkins-hbase20:44195] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-07-13 07:15:43,139 DEBUG [RS:0;jenkins-hbase20:42807] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-13 07:15:43,139 DEBUG [RS:1;jenkins-hbase20:44195] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-13 07:15:43,139 DEBUG [RS:1;jenkins-hbase20:44195] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-13 07:15:43,140 DEBUG [RS:1;jenkins-hbase20:44195] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-13 07:15:43,140 DEBUG [RS:1;jenkins-hbase20:44195] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-13 07:15:43,146 INFO [RS:1;jenkins-hbase20:44195] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-13 07:15:43,146 INFO [RS:1;jenkins-hbase20:44195] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-13 07:15:43,147 INFO [RS:1;jenkins-hbase20:44195] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-13 07:15:43,149 INFO [RS:2;jenkins-hbase20:44607] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-13 07:15:43,149 INFO [RS:2;jenkins-hbase20:44607] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-13 07:15:43,149 INFO [RS:0;jenkins-hbase20:42807] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-13 07:15:43,149 INFO [RS:2;jenkins-hbase20:44607] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-13 07:15:43,149 INFO [RS:0;jenkins-hbase20:42807] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-13 07:15:43,150 INFO [RS:0;jenkins-hbase20:42807] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-13 07:15:43,166 INFO [RS:0;jenkins-hbase20:42807] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-13 07:15:43,166 INFO [RS:2;jenkins-hbase20:44607] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-13 07:15:43,166 INFO [RS:1;jenkins-hbase20:44195] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-13 07:15:43,170 INFO [RS:0;jenkins-hbase20:42807] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,42807,1689232541407-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-13 07:15:43,170 INFO [RS:1;jenkins-hbase20:44195] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,44195,1689232541463-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-13 07:15:43,170 INFO [RS:2;jenkins-hbase20:44607] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,44607,1689232541504-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-13 07:15:43,197 INFO [RS:2;jenkins-hbase20:44607] regionserver.Replication(203): jenkins-hbase20.apache.org,44607,1689232541504 started 2023-07-13 07:15:43,197 INFO [RS:2;jenkins-hbase20:44607] regionserver.HRegionServer(1637): Serving as jenkins-hbase20.apache.org,44607,1689232541504, RpcServer on jenkins-hbase20.apache.org/148.251.75.209:44607, sessionid=0x100852f7ac90003 2023-07-13 07:15:43,199 INFO [RS:1;jenkins-hbase20:44195] regionserver.Replication(203): jenkins-hbase20.apache.org,44195,1689232541463 started 2023-07-13 07:15:43,199 DEBUG [RS:2;jenkins-hbase20:44607] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-13 07:15:43,200 INFO [RS:1;jenkins-hbase20:44195] regionserver.HRegionServer(1637): Serving as jenkins-hbase20.apache.org,44195,1689232541463, RpcServer on jenkins-hbase20.apache.org/148.251.75.209:44195, sessionid=0x100852f7ac90002 2023-07-13 07:15:43,200 DEBUG [RS:2;jenkins-hbase20:44607] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:15:43,200 DEBUG [RS:1;jenkins-hbase20:44195] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-13 07:15:43,200 DEBUG [RS:2;jenkins-hbase20:44607] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,44607,1689232541504' 2023-07-13 07:15:43,200 DEBUG [RS:2;jenkins-hbase20:44607] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-13 07:15:43,200 DEBUG [RS:1;jenkins-hbase20:44195] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:15:43,201 DEBUG [RS:1;jenkins-hbase20:44195] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,44195,1689232541463' 2023-07-13 07:15:43,202 DEBUG [RS:1;jenkins-hbase20:44195] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-13 07:15:43,202 DEBUG [RS:2;jenkins-hbase20:44607] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-13 07:15:43,202 DEBUG [RS:2;jenkins-hbase20:44607] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-13 07:15:43,203 DEBUG [RS:2;jenkins-hbase20:44607] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-13 07:15:43,203 DEBUG [RS:2;jenkins-hbase20:44607] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:15:43,203 DEBUG [RS:2;jenkins-hbase20:44607] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,44607,1689232541504' 2023-07-13 07:15:43,203 DEBUG [RS:2;jenkins-hbase20:44607] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:15:43,203 DEBUG [RS:1;jenkins-hbase20:44195] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-13 07:15:43,204 DEBUG [RS:2;jenkins-hbase20:44607] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:15:43,204 DEBUG [RS:1;jenkins-hbase20:44195] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-13 07:15:43,204 DEBUG [RS:1;jenkins-hbase20:44195] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-13 07:15:43,204 DEBUG [RS:1;jenkins-hbase20:44195] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:15:43,204 DEBUG [RS:1;jenkins-hbase20:44195] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,44195,1689232541463' 2023-07-13 07:15:43,204 DEBUG [RS:1;jenkins-hbase20:44195] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:15:43,205 DEBUG [RS:2;jenkins-hbase20:44607] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-13 07:15:43,205 INFO [RS:2;jenkins-hbase20:44607] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-13 07:15:43,205 DEBUG [RS:1;jenkins-hbase20:44195] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:15:43,206 INFO [RS:2;jenkins-hbase20:44607] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-13 07:15:43,206 DEBUG [RS:1;jenkins-hbase20:44195] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-13 07:15:43,206 INFO [RS:1;jenkins-hbase20:44195] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-13 07:15:43,207 INFO [RS:1;jenkins-hbase20:44195] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-13 07:15:43,213 INFO [RS:0;jenkins-hbase20:42807] regionserver.Replication(203): jenkins-hbase20.apache.org,42807,1689232541407 started 2023-07-13 07:15:43,213 INFO [RS:0;jenkins-hbase20:42807] regionserver.HRegionServer(1637): Serving as jenkins-hbase20.apache.org,42807,1689232541407, RpcServer on jenkins-hbase20.apache.org/148.251.75.209:42807, sessionid=0x100852f7ac90001 2023-07-13 07:15:43,213 DEBUG [RS:0;jenkins-hbase20:42807] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-13 07:15:43,213 DEBUG [RS:0;jenkins-hbase20:42807] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:15:43,213 DEBUG [RS:0;jenkins-hbase20:42807] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,42807,1689232541407' 2023-07-13 07:15:43,213 DEBUG [RS:0;jenkins-hbase20:42807] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-13 07:15:43,214 DEBUG [RS:0;jenkins-hbase20:42807] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-13 07:15:43,214 DEBUG [RS:0;jenkins-hbase20:42807] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-13 07:15:43,214 DEBUG [RS:0;jenkins-hbase20:42807] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-13 07:15:43,214 DEBUG [RS:0;jenkins-hbase20:42807] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:15:43,214 DEBUG [RS:0;jenkins-hbase20:42807] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,42807,1689232541407' 2023-07-13 07:15:43,214 DEBUG [RS:0;jenkins-hbase20:42807] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:15:43,215 DEBUG [RS:0;jenkins-hbase20:42807] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:15:43,215 DEBUG [RS:0;jenkins-hbase20:42807] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-13 07:15:43,215 INFO [RS:0;jenkins-hbase20:42807] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-13 07:15:43,215 INFO [RS:0;jenkins-hbase20:42807] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-13 07:15:43,258 DEBUG [jenkins-hbase20:37475] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-07-13 07:15:43,262 DEBUG [jenkins-hbase20:37475] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-07-13 07:15:43,268 DEBUG [jenkins-hbase20:37475] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-13 07:15:43,268 DEBUG [jenkins-hbase20:37475] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-13 07:15:43,268 DEBUG [jenkins-hbase20:37475] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-13 07:15:43,268 DEBUG [jenkins-hbase20:37475] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-13 07:15:43,271 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,44195,1689232541463, state=OPENING 2023-07-13 07:15:43,279 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-13 07:15:43,280 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-13 07:15:43,281 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-13 07:15:43,286 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,44195,1689232541463}] 2023-07-13 07:15:43,317 INFO [RS:2;jenkins-hbase20:44607] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C44607%2C1689232541504, suffix=, logDir=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/WALs/jenkins-hbase20.apache.org,44607,1689232541504, archiveDir=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/oldWALs, maxLogs=32 2023-07-13 07:15:43,317 INFO [RS:1;jenkins-hbase20:44195] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C44195%2C1689232541463, suffix=, logDir=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/WALs/jenkins-hbase20.apache.org,44195,1689232541463, archiveDir=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/oldWALs, maxLogs=32 2023-07-13 07:15:43,320 INFO [RS:0;jenkins-hbase20:42807] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C42807%2C1689232541407, suffix=, logDir=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/WALs/jenkins-hbase20.apache.org,42807,1689232541407, archiveDir=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/oldWALs, maxLogs=32 2023-07-13 07:15:43,362 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46849,DS-b781829b-0949-4e2e-be72-5c5015b63567,DISK] 2023-07-13 07:15:43,362 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34233,DS-dd3f8a11-abac-47d1-b0ca-d247a2fa9f44,DISK] 2023-07-13 07:15:43,367 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45545,DS-00f0df26-5a1a-4224-a64c-80f7bcd3c8df,DISK] 2023-07-13 07:15:43,368 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45545,DS-00f0df26-5a1a-4224-a64c-80f7bcd3c8df,DISK] 2023-07-13 07:15:43,370 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34233,DS-dd3f8a11-abac-47d1-b0ca-d247a2fa9f44,DISK] 2023-07-13 07:15:43,370 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46849,DS-b781829b-0949-4e2e-be72-5c5015b63567,DISK] 2023-07-13 07:15:43,380 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45545,DS-00f0df26-5a1a-4224-a64c-80f7bcd3c8df,DISK] 2023-07-13 07:15:43,382 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34233,DS-dd3f8a11-abac-47d1-b0ca-d247a2fa9f44,DISK] 2023-07-13 07:15:43,382 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46849,DS-b781829b-0949-4e2e-be72-5c5015b63567,DISK] 2023-07-13 07:15:43,383 INFO [RS:0;jenkins-hbase20:42807] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/WALs/jenkins-hbase20.apache.org,42807,1689232541407/jenkins-hbase20.apache.org%2C42807%2C1689232541407.1689232543322 2023-07-13 07:15:43,384 DEBUG [RS:0;jenkins-hbase20:42807] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34233,DS-dd3f8a11-abac-47d1-b0ca-d247a2fa9f44,DISK], DatanodeInfoWithStorage[127.0.0.1:45545,DS-00f0df26-5a1a-4224-a64c-80f7bcd3c8df,DISK], DatanodeInfoWithStorage[127.0.0.1:46849,DS-b781829b-0949-4e2e-be72-5c5015b63567,DISK]] 2023-07-13 07:15:43,399 INFO [RS:1;jenkins-hbase20:44195] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/WALs/jenkins-hbase20.apache.org,44195,1689232541463/jenkins-hbase20.apache.org%2C44195%2C1689232541463.1689232543322 2023-07-13 07:15:43,399 INFO [RS:2;jenkins-hbase20:44607] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/WALs/jenkins-hbase20.apache.org,44607,1689232541504/jenkins-hbase20.apache.org%2C44607%2C1689232541504.1689232543324 2023-07-13 07:15:43,402 DEBUG [RS:1;jenkins-hbase20:44195] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45545,DS-00f0df26-5a1a-4224-a64c-80f7bcd3c8df,DISK], DatanodeInfoWithStorage[127.0.0.1:34233,DS-dd3f8a11-abac-47d1-b0ca-d247a2fa9f44,DISK], DatanodeInfoWithStorage[127.0.0.1:46849,DS-b781829b-0949-4e2e-be72-5c5015b63567,DISK]] 2023-07-13 07:15:43,403 DEBUG [RS:2;jenkins-hbase20:44607] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45545,DS-00f0df26-5a1a-4224-a64c-80f7bcd3c8df,DISK], DatanodeInfoWithStorage[127.0.0.1:46849,DS-b781829b-0949-4e2e-be72-5c5015b63567,DISK], DatanodeInfoWithStorage[127.0.0.1:34233,DS-dd3f8a11-abac-47d1-b0ca-d247a2fa9f44,DISK]] 2023-07-13 07:15:43,483 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:15:43,487 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-13 07:15:43,493 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:54558, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-13 07:15:43,507 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-13 07:15:43,508 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-13 07:15:43,512 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C44195%2C1689232541463.meta, suffix=.meta, logDir=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/WALs/jenkins-hbase20.apache.org,44195,1689232541463, archiveDir=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/oldWALs, maxLogs=32 2023-07-13 07:15:43,543 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34233,DS-dd3f8a11-abac-47d1-b0ca-d247a2fa9f44,DISK] 2023-07-13 07:15:43,546 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45545,DS-00f0df26-5a1a-4224-a64c-80f7bcd3c8df,DISK] 2023-07-13 07:15:43,546 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46849,DS-b781829b-0949-4e2e-be72-5c5015b63567,DISK] 2023-07-13 07:15:43,560 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/WALs/jenkins-hbase20.apache.org,44195,1689232541463/jenkins-hbase20.apache.org%2C44195%2C1689232541463.meta.1689232543514.meta 2023-07-13 07:15:43,561 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34233,DS-dd3f8a11-abac-47d1-b0ca-d247a2fa9f44,DISK], DatanodeInfoWithStorage[127.0.0.1:45545,DS-00f0df26-5a1a-4224-a64c-80f7bcd3c8df,DISK], DatanodeInfoWithStorage[127.0.0.1:46849,DS-b781829b-0949-4e2e-be72-5c5015b63567,DISK]] 2023-07-13 07:15:43,561 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-13 07:15:43,563 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-07-13 07:15:43,564 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-13 07:15:43,565 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-13 07:15:43,568 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-13 07:15:43,570 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-13 07:15:43,587 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-13 07:15:43,587 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 07:15:43,587 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-13 07:15:43,587 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-13 07:15:43,590 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-13 07:15:43,592 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/hbase/meta/1588230740/info 2023-07-13 07:15:43,592 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/hbase/meta/1588230740/info 2023-07-13 07:15:43,593 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-13 07:15:43,593 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-13 07:15:43,594 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-13 07:15:43,595 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/hbase/meta/1588230740/rep_barrier 2023-07-13 07:15:43,595 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/hbase/meta/1588230740/rep_barrier 2023-07-13 07:15:43,596 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-13 07:15:43,597 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-13 07:15:43,597 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-13 07:15:43,598 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/hbase/meta/1588230740/table 2023-07-13 07:15:43,598 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/hbase/meta/1588230740/table 2023-07-13 07:15:43,599 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-13 07:15:43,600 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-13 07:15:43,602 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/hbase/meta/1588230740 2023-07-13 07:15:43,606 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/hbase/meta/1588230740 2023-07-13 07:15:43,610 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-13 07:15:43,613 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-13 07:15:43,615 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62022047, jitterRate=-0.07579948008060455}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-13 07:15:43,617 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-13 07:15:43,632 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1689232543473 2023-07-13 07:15:43,655 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-13 07:15:43,656 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-13 07:15:43,657 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,44195,1689232541463, state=OPEN 2023-07-13 07:15:43,660 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-13 07:15:43,660 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-13 07:15:43,666 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-13 07:15:43,666 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,44195,1689232541463 in 375 msec 2023-07-13 07:15:43,673 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-13 07:15:43,673 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 588 msec 2023-07-13 07:15:43,679 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 935 msec 2023-07-13 07:15:43,680 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1689232543680, completionTime=-1 2023-07-13 07:15:43,680 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-07-13 07:15:43,680 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-13 07:15:43,763 DEBUG [hconnection-0xd7981d0-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 07:15:43,766 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:54568, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 07:15:43,786 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-07-13 07:15:43,786 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689232603786 2023-07-13 07:15:43,786 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689232663786 2023-07-13 07:15:43,786 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 106 msec 2023-07-13 07:15:43,815 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,37475,1689232540263-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-13 07:15:43,815 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,37475,1689232540263-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-13 07:15:43,815 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,37475,1689232540263-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-13 07:15:43,817 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase20:37475, period=300000, unit=MILLISECONDS is enabled. 2023-07-13 07:15:43,818 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-13 07:15:43,825 DEBUG [master/jenkins-hbase20:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-13 07:15:43,839 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-13 07:15:43,841 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-13 07:15:43,852 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-13 07:15:43,855 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-13 07:15:43,860 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-13 07:15:43,885 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/hbase/namespace/3a0868eccd6b479e990b6482c6f4f5de 2023-07-13 07:15:43,887 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/hbase/namespace/3a0868eccd6b479e990b6482c6f4f5de empty. 2023-07-13 07:15:43,888 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/hbase/namespace/3a0868eccd6b479e990b6482c6f4f5de 2023-07-13 07:15:43,888 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-13 07:15:43,958 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-13 07:15:43,963 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 3a0868eccd6b479e990b6482c6f4f5de, NAME => 'hbase:namespace,,1689232543840.3a0868eccd6b479e990b6482c6f4f5de.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp 2023-07-13 07:15:43,990 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689232543840.3a0868eccd6b479e990b6482c6f4f5de.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 07:15:43,990 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 3a0868eccd6b479e990b6482c6f4f5de, disabling compactions & flushes 2023-07-13 07:15:43,990 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689232543840.3a0868eccd6b479e990b6482c6f4f5de. 2023-07-13 07:15:43,990 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689232543840.3a0868eccd6b479e990b6482c6f4f5de. 2023-07-13 07:15:43,990 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689232543840.3a0868eccd6b479e990b6482c6f4f5de. after waiting 0 ms 2023-07-13 07:15:43,990 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689232543840.3a0868eccd6b479e990b6482c6f4f5de. 2023-07-13 07:15:43,990 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689232543840.3a0868eccd6b479e990b6482c6f4f5de. 2023-07-13 07:15:43,990 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 3a0868eccd6b479e990b6482c6f4f5de: 2023-07-13 07:15:43,995 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-13 07:15:44,015 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1689232543840.3a0868eccd6b479e990b6482c6f4f5de.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689232543999"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689232543999"}]},"ts":"1689232543999"} 2023-07-13 07:15:44,051 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-13 07:15:44,055 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-13 07:15:44,060 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689232544055"}]},"ts":"1689232544055"} 2023-07-13 07:15:44,068 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-13 07:15:44,072 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-07-13 07:15:44,073 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-13 07:15:44,074 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-13 07:15:44,074 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-13 07:15:44,074 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-13 07:15:44,077 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=3a0868eccd6b479e990b6482c6f4f5de, ASSIGN}] 2023-07-13 07:15:44,081 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=3a0868eccd6b479e990b6482c6f4f5de, ASSIGN 2023-07-13 07:15:44,083 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=3a0868eccd6b479e990b6482c6f4f5de, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,44607,1689232541504; forceNewPlan=false, retain=false 2023-07-13 07:15:44,236 INFO [jenkins-hbase20:37475] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-13 07:15:44,237 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=3a0868eccd6b479e990b6482c6f4f5de, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:15:44,237 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1689232543840.3a0868eccd6b479e990b6482c6f4f5de.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689232544237"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689232544237"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689232544237"}]},"ts":"1689232544237"} 2023-07-13 07:15:44,243 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 3a0868eccd6b479e990b6482c6f4f5de, server=jenkins-hbase20.apache.org,44607,1689232541504}] 2023-07-13 07:15:44,403 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:15:44,403 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-13 07:15:44,408 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:37804, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-13 07:15:44,418 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1689232543840.3a0868eccd6b479e990b6482c6f4f5de. 2023-07-13 07:15:44,419 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 3a0868eccd6b479e990b6482c6f4f5de, NAME => 'hbase:namespace,,1689232543840.3a0868eccd6b479e990b6482c6f4f5de.', STARTKEY => '', ENDKEY => ''} 2023-07-13 07:15:44,419 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1689232543840.3a0868eccd6b479e990b6482c6f4f5de. service=AccessControlService 2023-07-13 07:15:44,420 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-13 07:15:44,421 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 3a0868eccd6b479e990b6482c6f4f5de 2023-07-13 07:15:44,421 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689232543840.3a0868eccd6b479e990b6482c6f4f5de.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 07:15:44,421 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 3a0868eccd6b479e990b6482c6f4f5de 2023-07-13 07:15:44,421 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 3a0868eccd6b479e990b6482c6f4f5de 2023-07-13 07:15:44,431 INFO [StoreOpener-3a0868eccd6b479e990b6482c6f4f5de-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 3a0868eccd6b479e990b6482c6f4f5de 2023-07-13 07:15:44,437 DEBUG [StoreOpener-3a0868eccd6b479e990b6482c6f4f5de-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/hbase/namespace/3a0868eccd6b479e990b6482c6f4f5de/info 2023-07-13 07:15:44,438 DEBUG [StoreOpener-3a0868eccd6b479e990b6482c6f4f5de-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/hbase/namespace/3a0868eccd6b479e990b6482c6f4f5de/info 2023-07-13 07:15:44,438 INFO [StoreOpener-3a0868eccd6b479e990b6482c6f4f5de-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3a0868eccd6b479e990b6482c6f4f5de columnFamilyName info 2023-07-13 07:15:44,440 INFO [StoreOpener-3a0868eccd6b479e990b6482c6f4f5de-1] regionserver.HStore(310): Store=3a0868eccd6b479e990b6482c6f4f5de/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-13 07:15:44,445 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/hbase/namespace/3a0868eccd6b479e990b6482c6f4f5de 2023-07-13 07:15:44,448 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/hbase/namespace/3a0868eccd6b479e990b6482c6f4f5de 2023-07-13 07:15:44,454 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 3a0868eccd6b479e990b6482c6f4f5de 2023-07-13 07:15:44,465 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/hbase/namespace/3a0868eccd6b479e990b6482c6f4f5de/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-13 07:15:44,467 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 3a0868eccd6b479e990b6482c6f4f5de; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74928494, jitterRate=0.11652156710624695}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-13 07:15:44,467 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 3a0868eccd6b479e990b6482c6f4f5de: 2023-07-13 07:15:44,482 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1689232543840.3a0868eccd6b479e990b6482c6f4f5de., pid=6, masterSystemTime=1689232544402 2023-07-13 07:15:44,490 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1689232543840.3a0868eccd6b479e990b6482c6f4f5de. 2023-07-13 07:15:44,490 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1689232543840.3a0868eccd6b479e990b6482c6f4f5de. 2023-07-13 07:15:44,493 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=3a0868eccd6b479e990b6482c6f4f5de, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:15:44,493 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1689232543840.3a0868eccd6b479e990b6482c6f4f5de.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689232544492"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689232544492"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689232544492"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689232544492"}]},"ts":"1689232544492"} 2023-07-13 07:15:44,503 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-13 07:15:44,503 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 3a0868eccd6b479e990b6482c6f4f5de, server=jenkins-hbase20.apache.org,44607,1689232541504 in 255 msec 2023-07-13 07:15:44,509 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-13 07:15:44,510 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=3a0868eccd6b479e990b6482c6f4f5de, ASSIGN in 426 msec 2023-07-13 07:15:44,512 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-13 07:15:44,512 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689232544512"}]},"ts":"1689232544512"} 2023-07-13 07:15:44,515 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-13 07:15:44,519 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-13 07:15:44,539 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 677 msec 2023-07-13 07:15:44,554 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-13 07:15:44,556 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-13 07:15:44,556 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-13 07:15:44,581 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 07:15:44,583 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:37818, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 07:15:44,599 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-13 07:15:44,624 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-13 07:15:44,633 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 40 msec 2023-07-13 07:15:44,644 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-13 07:15:44,657 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-13 07:15:44,663 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 18 msec 2023-07-13 07:15:44,678 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-13 07:15:44,680 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-13 07:15:44,682 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.105sec 2023-07-13 07:15:44,685 INFO [master/jenkins-hbase20:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-13 07:15:44,686 INFO [master/jenkins-hbase20:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-13 07:15:44,687 INFO [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-13 07:15:44,688 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,37475,1689232540263-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-13 07:15:44,689 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,37475,1689232540263-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-13 07:15:44,711 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-13 07:15:44,713 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-07-13 07:15:44,716 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-07-13 07:15:44,721 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-13 07:15:44,721 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-07-13 07:15:44,724 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/hbase/acl/a2bac6de91a657b465094c198afccca7 2023-07-13 07:15:44,725 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/hbase/acl/a2bac6de91a657b465094c198afccca7 empty. 2023-07-13 07:15:44,728 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/hbase/acl/a2bac6de91a657b465094c198afccca7 2023-07-13 07:15:44,728 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-07-13 07:15:44,730 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-13 07:15:44,745 DEBUG [Listener at localhost.localdomain/37489] zookeeper.ReadOnlyZKClient(139): Connect 0x2f7ef0ac to 127.0.0.1:58099 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-13 07:15:44,764 DEBUG [Listener at localhost.localdomain/37489] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@518682ba, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-13 07:15:44,777 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-07-13 07:15:44,782 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => a2bac6de91a657b465094c198afccca7, NAME => 'hbase:acl,,1689232544705.a2bac6de91a657b465094c198afccca7.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp 2023-07-13 07:15:44,806 DEBUG [hconnection-0x44ee53f4-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 07:15:44,817 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689232544705.a2bac6de91a657b465094c198afccca7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 07:15:44,817 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing a2bac6de91a657b465094c198afccca7, disabling compactions & flushes 2023-07-13 07:15:44,818 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689232544705.a2bac6de91a657b465094c198afccca7. 2023-07-13 07:15:44,818 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689232544705.a2bac6de91a657b465094c198afccca7. 2023-07-13 07:15:44,818 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689232544705.a2bac6de91a657b465094c198afccca7. after waiting 0 ms 2023-07-13 07:15:44,818 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689232544705.a2bac6de91a657b465094c198afccca7. 2023-07-13 07:15:44,818 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1689232544705.a2bac6de91a657b465094c198afccca7. 2023-07-13 07:15:44,818 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for a2bac6de91a657b465094c198afccca7: 2023-07-13 07:15:44,824 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-07-13 07:15:44,826 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1689232544705.a2bac6de91a657b465094c198afccca7.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689232544825"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689232544825"}]},"ts":"1689232544825"} 2023-07-13 07:15:44,826 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:54576, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 07:15:44,829 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-13 07:15:44,829 INFO [Listener at localhost.localdomain/37489] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase20.apache.org,37475,1689232540263 2023-07-13 07:15:44,829 INFO [Listener at localhost.localdomain/37489] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-07-13 07:15:44,829 INFO [Listener at localhost.localdomain/37489] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a827846-4542-2630-0c34-c6bc20d13d68/test.cache.data in system properties and HBase conf 2023-07-13 07:15:44,829 INFO [Listener at localhost.localdomain/37489] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a827846-4542-2630-0c34-c6bc20d13d68/hadoop.tmp.dir in system properties and HBase conf 2023-07-13 07:15:44,830 INFO [Listener at localhost.localdomain/37489] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a827846-4542-2630-0c34-c6bc20d13d68/hadoop.log.dir in system properties and HBase conf 2023-07-13 07:15:44,830 INFO [Listener at localhost.localdomain/37489] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a827846-4542-2630-0c34-c6bc20d13d68/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-13 07:15:44,830 INFO [Listener at localhost.localdomain/37489] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a827846-4542-2630-0c34-c6bc20d13d68/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-13 07:15:44,830 INFO [Listener at localhost.localdomain/37489] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-13 07:15:44,830 INFO [Listener at localhost.localdomain/37489] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a827846-4542-2630-0c34-c6bc20d13d68/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-13 07:15:44,830 INFO [Listener at localhost.localdomain/37489] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a827846-4542-2630-0c34-c6bc20d13d68/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-13 07:15:44,830 INFO [Listener at localhost.localdomain/37489] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a827846-4542-2630-0c34-c6bc20d13d68/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-13 07:15:44,831 INFO [Listener at localhost.localdomain/37489] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a827846-4542-2630-0c34-c6bc20d13d68/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-13 07:15:44,831 INFO [Listener at localhost.localdomain/37489] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a827846-4542-2630-0c34-c6bc20d13d68/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-13 07:15:44,831 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-13 07:15:44,831 INFO [Listener at localhost.localdomain/37489] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a827846-4542-2630-0c34-c6bc20d13d68/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-13 07:15:44,831 INFO [Listener at localhost.localdomain/37489] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a827846-4542-2630-0c34-c6bc20d13d68/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-13 07:15:44,831 INFO [Listener at localhost.localdomain/37489] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a827846-4542-2630-0c34-c6bc20d13d68/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-13 07:15:44,831 INFO [Listener at localhost.localdomain/37489] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a827846-4542-2630-0c34-c6bc20d13d68/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-13 07:15:44,831 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689232544831"}]},"ts":"1689232544831"} 2023-07-13 07:15:44,831 INFO [Listener at localhost.localdomain/37489] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a827846-4542-2630-0c34-c6bc20d13d68/nfs.dump.dir in system properties and HBase conf 2023-07-13 07:15:44,831 INFO [Listener at localhost.localdomain/37489] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a827846-4542-2630-0c34-c6bc20d13d68/java.io.tmpdir in system properties and HBase conf 2023-07-13 07:15:44,831 INFO [Listener at localhost.localdomain/37489] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a827846-4542-2630-0c34-c6bc20d13d68/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-13 07:15:44,831 INFO [Listener at localhost.localdomain/37489] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a827846-4542-2630-0c34-c6bc20d13d68/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-13 07:15:44,832 INFO [Listener at localhost.localdomain/37489] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a827846-4542-2630-0c34-c6bc20d13d68/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-07-13 07:15:44,834 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-07-13 07:15:44,834 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-13 07:15:44,837 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-07-13 07:15:44,838 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-13 07:15:44,838 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-13 07:15:44,839 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-13 07:15:44,839 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-13 07:15:44,839 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=a2bac6de91a657b465094c198afccca7, ASSIGN}] 2023-07-13 07:15:44,843 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=a2bac6de91a657b465094c198afccca7, ASSIGN 2023-07-13 07:15:44,844 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=a2bac6de91a657b465094c198afccca7, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,44607,1689232541504; forceNewPlan=false, retain=false 2023-07-13 07:15:44,995 INFO [jenkins-hbase20:37475] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-13 07:15:44,996 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=a2bac6de91a657b465094c198afccca7, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:15:44,996 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1689232544705.a2bac6de91a657b465094c198afccca7.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689232544995"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689232544995"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689232544995"}]},"ts":"1689232544995"} 2023-07-13 07:15:44,999 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure a2bac6de91a657b465094c198afccca7, server=jenkins-hbase20.apache.org,44607,1689232541504}] 2023-07-13 07:15:45,034 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-13 07:15:45,161 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1689232544705.a2bac6de91a657b465094c198afccca7. 2023-07-13 07:15:45,162 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a2bac6de91a657b465094c198afccca7, NAME => 'hbase:acl,,1689232544705.a2bac6de91a657b465094c198afccca7.', STARTKEY => '', ENDKEY => ''} 2023-07-13 07:15:45,162 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1689232544705.a2bac6de91a657b465094c198afccca7. service=AccessControlService 2023-07-13 07:15:45,162 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-13 07:15:45,163 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl a2bac6de91a657b465094c198afccca7 2023-07-13 07:15:45,163 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689232544705.a2bac6de91a657b465094c198afccca7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 07:15:45,163 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for a2bac6de91a657b465094c198afccca7 2023-07-13 07:15:45,163 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for a2bac6de91a657b465094c198afccca7 2023-07-13 07:15:45,169 INFO [StoreOpener-a2bac6de91a657b465094c198afccca7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region a2bac6de91a657b465094c198afccca7 2023-07-13 07:15:45,172 DEBUG [StoreOpener-a2bac6de91a657b465094c198afccca7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/hbase/acl/a2bac6de91a657b465094c198afccca7/l 2023-07-13 07:15:45,172 DEBUG [StoreOpener-a2bac6de91a657b465094c198afccca7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/hbase/acl/a2bac6de91a657b465094c198afccca7/l 2023-07-13 07:15:45,172 INFO [StoreOpener-a2bac6de91a657b465094c198afccca7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a2bac6de91a657b465094c198afccca7 columnFamilyName l 2023-07-13 07:15:45,174 INFO [StoreOpener-a2bac6de91a657b465094c198afccca7-1] regionserver.HStore(310): Store=a2bac6de91a657b465094c198afccca7/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-13 07:15:45,177 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/hbase/acl/a2bac6de91a657b465094c198afccca7 2023-07-13 07:15:45,179 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/hbase/acl/a2bac6de91a657b465094c198afccca7 2023-07-13 07:15:45,186 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for a2bac6de91a657b465094c198afccca7 2023-07-13 07:15:45,190 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/hbase/acl/a2bac6de91a657b465094c198afccca7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-13 07:15:45,191 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened a2bac6de91a657b465094c198afccca7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71221951, jitterRate=0.061289772391319275}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-13 07:15:45,191 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for a2bac6de91a657b465094c198afccca7: 2023-07-13 07:15:45,193 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1689232544705.a2bac6de91a657b465094c198afccca7., pid=11, masterSystemTime=1689232545153 2023-07-13 07:15:45,196 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1689232544705.a2bac6de91a657b465094c198afccca7. 2023-07-13 07:15:45,196 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1689232544705.a2bac6de91a657b465094c198afccca7. 2023-07-13 07:15:45,197 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=a2bac6de91a657b465094c198afccca7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:15:45,198 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1689232544705.a2bac6de91a657b465094c198afccca7.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689232545197"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689232545197"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689232545197"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689232545197"}]},"ts":"1689232545197"} 2023-07-13 07:15:45,208 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-07-13 07:15:45,208 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure a2bac6de91a657b465094c198afccca7, server=jenkins-hbase20.apache.org,44607,1689232541504 in 203 msec 2023-07-13 07:15:45,212 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-07-13 07:15:45,212 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=a2bac6de91a657b465094c198afccca7, ASSIGN in 369 msec 2023-07-13 07:15:45,214 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-13 07:15:45,214 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689232545214"}]},"ts":"1689232545214"} 2023-07-13 07:15:45,217 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-07-13 07:15:45,335 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-13 07:15:45,446 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-07-13 07:15:45,457 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 735 msec 2023-07-13 07:15:45,835 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-13 07:15:45,835 INFO [master/jenkins-hbase20:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-07-13 07:15:45,848 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-13 07:15:46,132 WARN [Thread-383] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-13 07:15:46,482 INFO [Thread-383] log.Slf4jLog(67): jetty-6.1.26 2023-07-13 07:15:46,489 INFO [Thread-383] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a827846-4542-2630-0c34-c6bc20d13d68/java.io.tmpdir/Jetty_jenkins.hbase20_apache_org_44981_jobhistory____.wj0ytt/webapp 2023-07-13 07:15:46,614 INFO [Thread-383] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-07-13 07:15:46,614 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-07-13 07:15:46,615 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-13 07:15:46,617 INFO [Thread-383] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-13 07:15:46,698 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-13 07:15:47,001 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-13 07:15:47,307 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-07-13 07:15:47,329 INFO [Thread-383] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase20.apache.org:44981 2023-07-13 07:15:47,609 WARN [Listener at jenkins-hbase20.apache.org/33571] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-13 07:15:47,837 WARN [Listener at jenkins-hbase20.apache.org/33571] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-13 07:15:47,838 INFO [Listener at jenkins-hbase20.apache.org/33571] log.Slf4jLog(67): jetty-6.1.26 2023-07-13 07:15:47,844 INFO [Listener at jenkins-hbase20.apache.org/33571] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a827846-4542-2630-0c34-c6bc20d13d68/java.io.tmpdir/Jetty_jenkins.hbase20_apache_org_42917_cluster____qm0bv3/webapp 2023-07-13 07:15:47,912 INFO [Listener at jenkins-hbase20.apache.org/33571] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-07-13 07:15:47,912 INFO [Listener at jenkins-hbase20.apache.org/33571] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-07-13 07:15:47,912 INFO [Listener at jenkins-hbase20.apache.org/33571] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-13 07:15:47,913 INFO [Listener at jenkins-hbase20.apache.org/33571] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-13 07:15:47,922 INFO [Listener at jenkins-hbase20.apache.org/33571] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-13 07:15:48,116 INFO [Listener at jenkins-hbase20.apache.org/33571] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-13 07:15:48,222 INFO [Listener at jenkins-hbase20.apache.org/33571] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-13 07:15:48,245 INFO [Listener at jenkins-hbase20.apache.org/33571] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase20.apache.org:42917 2023-07-13 07:15:48,908 WARN [Listener at jenkins-hbase20.apache.org/38439] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-13 07:15:48,931 WARN [Listener at jenkins-hbase20.apache.org/38439] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-13 07:15:48,932 INFO [Listener at jenkins-hbase20.apache.org/38439] log.Slf4jLog(67): jetty-6.1.26 2023-07-13 07:15:48,938 INFO [Listener at jenkins-hbase20.apache.org/38439] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a827846-4542-2630-0c34-c6bc20d13d68/java.io.tmpdir/Jetty_jenkins.hbase20_apache_org_37715_node____9t0kuh/webapp 2023-07-13 07:15:48,985 INFO [Listener at jenkins-hbase20.apache.org/38439] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-13 07:15:48,985 INFO [Listener at jenkins-hbase20.apache.org/38439] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-13 07:15:48,986 INFO [Listener at jenkins-hbase20.apache.org/38439] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-13 07:15:48,986 INFO [Listener at jenkins-hbase20.apache.org/38439] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-13 07:15:48,993 INFO [Listener at jenkins-hbase20.apache.org/38439] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-13 07:15:49,012 INFO [Listener at jenkins-hbase20.apache.org/38439] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-13 07:15:49,095 INFO [Listener at jenkins-hbase20.apache.org/38439] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-13 07:15:49,111 INFO [Listener at jenkins-hbase20.apache.org/38439] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase20.apache.org:37715 2023-07-13 07:15:49,222 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-13 07:15:49,399 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-13 07:15:49,400 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-13 07:15:49,401 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-07-13 07:15:49,570 WARN [Listener at jenkins-hbase20.apache.org/34497] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-13 07:15:49,581 WARN [Listener at jenkins-hbase20.apache.org/34497] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-13 07:15:49,581 INFO [Listener at jenkins-hbase20.apache.org/34497] log.Slf4jLog(67): jetty-6.1.26 2023-07-13 07:15:49,588 INFO [Listener at jenkins-hbase20.apache.org/34497] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a827846-4542-2630-0c34-c6bc20d13d68/java.io.tmpdir/Jetty_jenkins.hbase20_apache_org_45239_node____n7h1vt/webapp 2023-07-13 07:15:49,639 INFO [Listener at jenkins-hbase20.apache.org/34497] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-13 07:15:49,639 INFO [Listener at jenkins-hbase20.apache.org/34497] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-13 07:15:49,639 INFO [Listener at jenkins-hbase20.apache.org/34497] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-13 07:15:49,640 INFO [Listener at jenkins-hbase20.apache.org/34497] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-13 07:15:49,652 INFO [Listener at jenkins-hbase20.apache.org/34497] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-13 07:15:49,672 INFO [Listener at jenkins-hbase20.apache.org/34497] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-13 07:15:49,757 INFO [Listener at jenkins-hbase20.apache.org/34497] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-13 07:15:49,765 INFO [Listener at jenkins-hbase20.apache.org/34497] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase20.apache.org:45239 2023-07-13 07:15:49,791 INFO [Listener at jenkins-hbase20.apache.org/34497] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-07-13 07:15:49,792 INFO [Listener at jenkins-hbase20.apache.org/34497] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-07-13 07:15:49,856 INFO [Listener at jenkins-hbase20.apache.org/34497] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportWithTargetName Thread=708, OpenFileDescriptor=902, MaxFileDescriptor=60000, SystemLoadAverage=468, ProcessCount=168, AvailableMemoryMB=3324 2023-07-13 07:15:49,856 WARN [Listener at jenkins-hbase20.apache.org/34497] hbase.ResourceChecker(130): Thread=708 is superior to 500 2023-07-13 07:15:49,871 DEBUG [Listener at jenkins-hbase20.apache.org/34497] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-13 07:15:49,877 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:51510, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-13 07:15:49,883 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-13 07:15:49,885 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-07-13 07:15:49,888 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-07-13 07:15:49,888 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-07-13 07:15:49,890 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-13 07:15:49,890 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-13 07:15:49,898 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testExportWithTargetName/619b6fe7e465e5c80c2c088e47805987 2023-07-13 07:15:49,899 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testExportWithTargetName/5ef6c4ea154e8783e5747813a9d6ca96 2023-07-13 07:15:49,900 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testExportWithTargetName/619b6fe7e465e5c80c2c088e47805987 empty. 2023-07-13 07:15:49,901 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testExportWithTargetName/5ef6c4ea154e8783e5747813a9d6ca96 empty. 2023-07-13 07:15:49,904 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testExportWithTargetName/619b6fe7e465e5c80c2c088e47805987 2023-07-13 07:15:49,904 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testExportWithTargetName/5ef6c4ea154e8783e5747813a9d6ca96 2023-07-13 07:15:49,904 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-13 07:15:49,946 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-07-13 07:15:49,948 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => 619b6fe7e465e5c80c2c088e47805987, NAME => 'testtb-testExportWithTargetName,,1689232549882.619b6fe7e465e5c80c2c088e47805987.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp 2023-07-13 07:15:49,954 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => 5ef6c4ea154e8783e5747813a9d6ca96, NAME => 'testtb-testExportWithTargetName,1,1689232549882.5ef6c4ea154e8783e5747813a9d6ca96.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp 2023-07-13 07:15:49,992 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689232549882.619b6fe7e465e5c80c2c088e47805987.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 07:15:49,997 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing 619b6fe7e465e5c80c2c088e47805987, disabling compactions & flushes 2023-07-13 07:15:49,997 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689232549882.619b6fe7e465e5c80c2c088e47805987. 2023-07-13 07:15:49,997 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689232549882.619b6fe7e465e5c80c2c088e47805987. 2023-07-13 07:15:49,997 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689232549882.619b6fe7e465e5c80c2c088e47805987. after waiting 0 ms 2023-07-13 07:15:49,997 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689232549882.619b6fe7e465e5c80c2c088e47805987. 2023-07-13 07:15:49,997 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689232549882.619b6fe7e465e5c80c2c088e47805987. 2023-07-13 07:15:49,997 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for 619b6fe7e465e5c80c2c088e47805987: 2023-07-13 07:15:49,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-13 07:15:50,000 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689232549882.5ef6c4ea154e8783e5747813a9d6ca96.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 07:15:50,000 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing 5ef6c4ea154e8783e5747813a9d6ca96, disabling compactions & flushes 2023-07-13 07:15:50,001 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689232549882.5ef6c4ea154e8783e5747813a9d6ca96. 2023-07-13 07:15:50,001 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689232549882.5ef6c4ea154e8783e5747813a9d6ca96. 2023-07-13 07:15:50,001 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689232549882.5ef6c4ea154e8783e5747813a9d6ca96. after waiting 0 ms 2023-07-13 07:15:50,001 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689232549882.5ef6c4ea154e8783e5747813a9d6ca96. 2023-07-13 07:15:50,001 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689232549882.5ef6c4ea154e8783e5747813a9d6ca96. 2023-07-13 07:15:50,001 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for 5ef6c4ea154e8783e5747813a9d6ca96: 2023-07-13 07:15:50,007 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-07-13 07:15:50,008 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689232549882.619b6fe7e465e5c80c2c088e47805987.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689232550008"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689232550008"}]},"ts":"1689232550008"} 2023-07-13 07:15:50,009 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689232549882.5ef6c4ea154e8783e5747813a9d6ca96.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689232550008"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689232550008"}]},"ts":"1689232550008"} 2023-07-13 07:15:50,064 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-13 07:15:50,066 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-13 07:15:50,066 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689232550066"}]},"ts":"1689232550066"} 2023-07-13 07:15:50,069 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-07-13 07:15:50,073 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-07-13 07:15:50,074 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-13 07:15:50,075 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-13 07:15:50,075 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-13 07:15:50,075 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-13 07:15:50,075 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=619b6fe7e465e5c80c2c088e47805987, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=5ef6c4ea154e8783e5747813a9d6ca96, ASSIGN}] 2023-07-13 07:15:50,078 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=5ef6c4ea154e8783e5747813a9d6ca96, ASSIGN 2023-07-13 07:15:50,078 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=619b6fe7e465e5c80c2c088e47805987, ASSIGN 2023-07-13 07:15:50,079 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=5ef6c4ea154e8783e5747813a9d6ca96, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,44195,1689232541463; forceNewPlan=false, retain=false 2023-07-13 07:15:50,079 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=619b6fe7e465e5c80c2c088e47805987, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,42807,1689232541407; forceNewPlan=false, retain=false 2023-07-13 07:15:50,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-13 07:15:50,230 INFO [jenkins-hbase20:37475] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-13 07:15:50,232 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=619b6fe7e465e5c80c2c088e47805987, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:15:50,232 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=5ef6c4ea154e8783e5747813a9d6ca96, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:15:50,233 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689232549882.619b6fe7e465e5c80c2c088e47805987.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689232550232"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689232550232"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689232550232"}]},"ts":"1689232550232"} 2023-07-13 07:15:50,233 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689232549882.5ef6c4ea154e8783e5747813a9d6ca96.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689232550232"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689232550232"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689232550232"}]},"ts":"1689232550232"} 2023-07-13 07:15:50,235 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=13, state=RUNNABLE; OpenRegionProcedure 619b6fe7e465e5c80c2c088e47805987, server=jenkins-hbase20.apache.org,42807,1689232541407}] 2023-07-13 07:15:50,238 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=14, state=RUNNABLE; OpenRegionProcedure 5ef6c4ea154e8783e5747813a9d6ca96, server=jenkins-hbase20.apache.org,44195,1689232541463}] 2023-07-13 07:15:50,390 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:15:50,391 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-13 07:15:50,400 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:47018, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-13 07:15:50,404 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1689232549882.5ef6c4ea154e8783e5747813a9d6ca96. 2023-07-13 07:15:50,406 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5ef6c4ea154e8783e5747813a9d6ca96, NAME => 'testtb-testExportWithTargetName,1,1689232549882.5ef6c4ea154e8783e5747813a9d6ca96.', STARTKEY => '1', ENDKEY => ''} 2023-07-13 07:15:50,406 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1689232549882.5ef6c4ea154e8783e5747813a9d6ca96. service=AccessControlService 2023-07-13 07:15:50,407 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-13 07:15:50,407 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 5ef6c4ea154e8783e5747813a9d6ca96 2023-07-13 07:15:50,407 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689232549882.5ef6c4ea154e8783e5747813a9d6ca96.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 07:15:50,407 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 5ef6c4ea154e8783e5747813a9d6ca96 2023-07-13 07:15:50,407 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 5ef6c4ea154e8783e5747813a9d6ca96 2023-07-13 07:15:50,410 INFO [StoreOpener-5ef6c4ea154e8783e5747813a9d6ca96-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 5ef6c4ea154e8783e5747813a9d6ca96 2023-07-13 07:15:50,410 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1689232549882.619b6fe7e465e5c80c2c088e47805987. 2023-07-13 07:15:50,410 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 619b6fe7e465e5c80c2c088e47805987, NAME => 'testtb-testExportWithTargetName,,1689232549882.619b6fe7e465e5c80c2c088e47805987.', STARTKEY => '', ENDKEY => '1'} 2023-07-13 07:15:50,412 DEBUG [StoreOpener-5ef6c4ea154e8783e5747813a9d6ca96-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testExportWithTargetName/5ef6c4ea154e8783e5747813a9d6ca96/cf 2023-07-13 07:15:50,413 DEBUG [StoreOpener-5ef6c4ea154e8783e5747813a9d6ca96-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testExportWithTargetName/5ef6c4ea154e8783e5747813a9d6ca96/cf 2023-07-13 07:15:50,415 INFO [StoreOpener-5ef6c4ea154e8783e5747813a9d6ca96-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5ef6c4ea154e8783e5747813a9d6ca96 columnFamilyName cf 2023-07-13 07:15:50,416 INFO [StoreOpener-5ef6c4ea154e8783e5747813a9d6ca96-1] regionserver.HStore(310): Store=5ef6c4ea154e8783e5747813a9d6ca96/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-13 07:15:50,416 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1689232549882.619b6fe7e465e5c80c2c088e47805987. service=AccessControlService 2023-07-13 07:15:50,421 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-13 07:15:50,421 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 619b6fe7e465e5c80c2c088e47805987 2023-07-13 07:15:50,421 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-13 07:15:50,424 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-07-13 07:15:50,424 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testExportWithTargetName/5ef6c4ea154e8783e5747813a9d6ca96 2023-07-13 07:15:50,424 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-13 07:15:50,424 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-07-13 07:15:50,424 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689232549882.619b6fe7e465e5c80c2c088e47805987.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 07:15:50,425 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 619b6fe7e465e5c80c2c088e47805987 2023-07-13 07:15:50,425 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 619b6fe7e465e5c80c2c088e47805987 2023-07-13 07:15:50,425 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-13 07:15:50,425 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-07-13 07:15:50,426 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-13 07:15:50,426 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-07-13 07:15:50,426 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testExportWithTargetName/5ef6c4ea154e8783e5747813a9d6ca96 2023-07-13 07:15:50,426 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-13 07:15:50,426 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-13 07:15:50,427 INFO [StoreOpener-619b6fe7e465e5c80c2c088e47805987-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 619b6fe7e465e5c80c2c088e47805987 2023-07-13 07:15:50,430 DEBUG [StoreOpener-619b6fe7e465e5c80c2c088e47805987-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testExportWithTargetName/619b6fe7e465e5c80c2c088e47805987/cf 2023-07-13 07:15:50,430 DEBUG [StoreOpener-619b6fe7e465e5c80c2c088e47805987-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testExportWithTargetName/619b6fe7e465e5c80c2c088e47805987/cf 2023-07-13 07:15:50,430 INFO [StoreOpener-619b6fe7e465e5c80c2c088e47805987-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 619b6fe7e465e5c80c2c088e47805987 columnFamilyName cf 2023-07-13 07:15:50,430 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 5ef6c4ea154e8783e5747813a9d6ca96 2023-07-13 07:15:50,431 INFO [StoreOpener-619b6fe7e465e5c80c2c088e47805987-1] regionserver.HStore(310): Store=619b6fe7e465e5c80c2c088e47805987/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-13 07:15:50,439 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testExportWithTargetName/619b6fe7e465e5c80c2c088e47805987 2023-07-13 07:15:50,441 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testExportWithTargetName/619b6fe7e465e5c80c2c088e47805987 2023-07-13 07:15:50,469 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 619b6fe7e465e5c80c2c088e47805987 2023-07-13 07:15:50,470 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testExportWithTargetName/5ef6c4ea154e8783e5747813a9d6ca96/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-13 07:15:50,471 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 5ef6c4ea154e8783e5747813a9d6ca96; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71447730, jitterRate=0.064654141664505}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-13 07:15:50,473 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 5ef6c4ea154e8783e5747813a9d6ca96: 2023-07-13 07:15:50,481 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testExportWithTargetName/619b6fe7e465e5c80c2c088e47805987/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-13 07:15:50,483 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1689232549882.5ef6c4ea154e8783e5747813a9d6ca96., pid=16, masterSystemTime=1689232550391 2023-07-13 07:15:50,484 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 619b6fe7e465e5c80c2c088e47805987; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72141284, jitterRate=0.07498890161514282}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-13 07:15:50,484 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 619b6fe7e465e5c80c2c088e47805987: 2023-07-13 07:15:50,486 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1689232549882.619b6fe7e465e5c80c2c088e47805987., pid=15, masterSystemTime=1689232550390 2023-07-13 07:15:50,495 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=5ef6c4ea154e8783e5747813a9d6ca96, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:15:50,496 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1689232549882.5ef6c4ea154e8783e5747813a9d6ca96. 2023-07-13 07:15:50,496 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1689232549882.5ef6c4ea154e8783e5747813a9d6ca96.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689232550495"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689232550495"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689232550495"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689232550495"}]},"ts":"1689232550495"} 2023-07-13 07:15:50,496 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1689232549882.5ef6c4ea154e8783e5747813a9d6ca96. 2023-07-13 07:15:50,497 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1689232549882.619b6fe7e465e5c80c2c088e47805987. 2023-07-13 07:15:50,502 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1689232549882.619b6fe7e465e5c80c2c088e47805987. 2023-07-13 07:15:50,504 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=619b6fe7e465e5c80c2c088e47805987, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:15:50,504 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1689232549882.619b6fe7e465e5c80c2c088e47805987.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689232550504"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689232550504"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689232550504"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689232550504"}]},"ts":"1689232550504"} 2023-07-13 07:15:50,504 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-13 07:15:50,512 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=14 2023-07-13 07:15:50,514 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=14, state=SUCCESS; OpenRegionProcedure 5ef6c4ea154e8783e5747813a9d6ca96, server=jenkins-hbase20.apache.org,44195,1689232541463 in 268 msec 2023-07-13 07:15:50,516 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=13 2023-07-13 07:15:50,517 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=13, state=SUCCESS; OpenRegionProcedure 619b6fe7e465e5c80c2c088e47805987, server=jenkins-hbase20.apache.org,42807,1689232541407 in 274 msec 2023-07-13 07:15:50,517 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=5ef6c4ea154e8783e5747813a9d6ca96, ASSIGN in 439 msec 2023-07-13 07:15:50,526 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=13, resume processing ppid=12 2023-07-13 07:15:50,526 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=619b6fe7e465e5c80c2c088e47805987, ASSIGN in 441 msec 2023-07-13 07:15:50,528 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-13 07:15:50,528 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689232550528"}]},"ts":"1689232550528"} 2023-07-13 07:15:50,531 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-07-13 07:15:50,534 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-07-13 07:15:50,540 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-07-13 07:15:50,555 DEBUG [hconnection-0x2349822b-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 07:15:50,559 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:52784, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=ClientService 2023-07-13 07:15:50,568 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44607] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-13 07:15:50,610 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-13 07:15:50,610 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-13 07:15:50,610 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-13 07:15:50,610 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-13 07:15:50,610 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-13 07:15:50,639 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-13 07:15:50,639 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-13 07:15:50,640 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-13 07:15:50,640 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-13 07:15:50,642 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 756 msec 2023-07-13 07:15:51,006 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-13 07:15:51,007 INFO [Listener at jenkins-hbase20.apache.org/34497] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-07-13 07:15:51,007 DEBUG [Listener at jenkins-hbase20.apache.org/34497] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportWithTargetName get assigned. Timeout = 60000ms 2023-07-13 07:15:51,009 INFO [Listener at jenkins-hbase20.apache.org/34497] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-13 07:15:51,017 INFO [Listener at jenkins-hbase20.apache.org/34497] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportWithTargetName assigned to meta. Checking AM states. 2023-07-13 07:15:51,018 INFO [Listener at jenkins-hbase20.apache.org/34497] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-13 07:15:51,018 INFO [Listener at jenkins-hbase20.apache.org/34497] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportWithTargetName assigned. 2023-07-13 07:15:51,030 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-13 07:15:51,030 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689232551030 (current time:1689232551030). 2023-07-13 07:15:51,030 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-13 07:15:51,031 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] zookeeper.ReadOnlyZKClient(139): Connect 0x7ad1ebfa to 127.0.0.1:58099 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-13 07:15:51,122 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@100765a3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-13 07:15:51,124 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 07:15:51,128 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:52792, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 07:15:51,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7ad1ebfa to 127.0.0.1:58099 2023-07-13 07:15:51,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 07:15:51,131 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] zookeeper.ReadOnlyZKClient(139): Connect 0x450d0528 to 127.0.0.1:58099 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-13 07:15:51,195 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@316891a7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-13 07:15:51,199 DEBUG [hconnection-0x64a78964-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 07:15:51,200 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:52794, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 07:15:51,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 07:15:51,207 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:37686, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 07:15:51,209 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x450d0528 to 127.0.0.1:58099 2023-07-13 07:15:51,209 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 07:15:51,209 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-13 07:15:51,235 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-13 07:15:51,236 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-13 07:15:51,259 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] procedure2.ProcedureExecutor(1029): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-13 07:15:51,261 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-13 07:15:51,262 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689233151262 2023-07-13 07:15:51,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-13 07:15:51,263 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-13 07:15:51,266 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-13 07:15:51,268 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-13 07:15:51,269 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 15 msec 2023-07-13 07:15:51,270 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-13 07:15:51,271 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689233151271 2023-07-13 07:15:51,272 DEBUG [Listener at jenkins-hbase20.apache.org/34497] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-13 07:15:51,272 DEBUG [Listener at jenkins-hbase20.apache.org/34497] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-13 07:15:51,296 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-07-13 07:15:51,297 INFO [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-07-13 07:15:51,297 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 07:15:51,298 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-07-13 07:15:51,298 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-13 07:15:51,299 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-13 07:15:51,299 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-13 07:15:51,302 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:15:51,302 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:15:51,302 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:15:51,302 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:15:51,302 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:15:51,302 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:15:51,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:15:51,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:15:51,302 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:15:51,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:15:51,303 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:15:51,303 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:15:51,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-13 07:15:51,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-13 07:15:51,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-13 07:15:51,303 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:15:51,303 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-13 07:15:51,303 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-13 07:15:51,303 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-13 07:15:51,303 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-13 07:15:51,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-13 07:15:51,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-13 07:15:51,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-13 07:15:51,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-13 07:15:51,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-13 07:15:51,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-13 07:15:51,304 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-13 07:15:51,304 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-13 07:15:51,304 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-13 07:15:51,307 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-13 07:15:51,307 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-13 07:15:51,307 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-13 07:15:51,311 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-13 07:15:51,311 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 07:15:51,311 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-13 07:15:51,312 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 07:15:51,312 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-13 07:15:51,313 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-13 07:15:51,312 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-13 07:15:51,313 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 07:15:51,313 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44607,1689232541504' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-13 07:15:51,313 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-13 07:15:51,314 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-13 07:15:51,314 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-13 07:15:51,314 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44195,1689232541463' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-13 07:15:51,314 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-13 07:15:51,314 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,42807,1689232541407' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-13 07:15:51,316 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:15:51,316 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-13 07:15:51,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:15:51,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 07:15:51,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 07:15:51,316 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:15:51,316 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-13 07:15:51,316 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-13 07:15:51,316 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-13 07:15:51,317 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 07:15:51,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 07:15:51,317 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-13 07:15:51,317 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 07:15:51,317 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-13 07:15:51,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 07:15:51,317 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 07:15:51,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-13 07:15:51,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:15:51,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:15:51,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:15:51,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 07:15:51,319 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44195,1689232541463' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-13 07:15:51,319 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@636a03c9[Count = 1] remaining members to acquire global barrier 2023-07-13 07:15:51,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:15:51,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 07:15:51,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 07:15:51,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 07:15:51,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 07:15:51,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-13 07:15:51,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:15:51,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:15:51,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:15:51,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 07:15:51,321 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,42807,1689232541407' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-13 07:15:51,321 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@636a03c9[Count = 0] remaining members to acquire global barrier 2023-07-13 07:15:51,321 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-13 07:15:51,321 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-13 07:15:51,323 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-13 07:15:51,323 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-13 07:15:51,323 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-13 07:15:51,323 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-13 07:15:51,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-13 07:15:51,323 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:15:51,323 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-13 07:15:51,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-13 07:15:51,323 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-13 07:15:51,323 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-13 07:15:51,324 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-13 07:15:51,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-13 07:15:51,324 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-13 07:15:51,324 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:15:51,324 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase20.apache.org,44607,1689232541504' in zk 2023-07-13 07:15:51,324 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-13 07:15:51,324 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-13 07:15:51,328 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-13 07:15:51,328 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-13 07:15:51,328 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-13 07:15:51,328 DEBUG [rs(jenkins-hbase20.apache.org,42807,1689232541407)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689232549882.619b6fe7e465e5c80c2c088e47805987. 2023-07-13 07:15:51,328 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-13 07:15:51,328 DEBUG [rs(jenkins-hbase20.apache.org,44195,1689232541463)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689232549882.5ef6c4ea154e8783e5747813a9d6ca96. 2023-07-13 07:15:51,328 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-13 07:15:51,328 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 07:15:51,328 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-13 07:15:51,330 DEBUG [rs(jenkins-hbase20.apache.org,44195,1689232541463)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689232549882.5ef6c4ea154e8783e5747813a9d6ca96. started... 2023-07-13 07:15:51,330 DEBUG [rs(jenkins-hbase20.apache.org,42807,1689232541407)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689232549882.619b6fe7e465e5c80c2c088e47805987. started... 2023-07-13 07:15:51,334 DEBUG [rs(jenkins-hbase20.apache.org,44195,1689232541463)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5ef6c4ea154e8783e5747813a9d6ca96: 2023-07-13 07:15:51,334 DEBUG [rs(jenkins-hbase20.apache.org,42807,1689232541407)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 619b6fe7e465e5c80c2c088e47805987: 2023-07-13 07:15:51,335 DEBUG [rs(jenkins-hbase20.apache.org,44195,1689232541463)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689232549882.5ef6c4ea154e8783e5747813a9d6ca96.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-13 07:15:51,335 DEBUG [rs(jenkins-hbase20.apache.org,42807,1689232541407)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689232549882.619b6fe7e465e5c80c2c088e47805987.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-13 07:15:51,339 DEBUG [rs(jenkins-hbase20.apache.org,44195,1689232541463)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-13 07:15:51,339 DEBUG [rs(jenkins-hbase20.apache.org,42807,1689232541407)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-13 07:15:51,342 DEBUG [rs(jenkins-hbase20.apache.org,44195,1689232541463)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-13 07:15:51,342 DEBUG [rs(jenkins-hbase20.apache.org,42807,1689232541407)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-13 07:15:51,372 DEBUG [Listener at jenkins-hbase20.apache.org/34497] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 07:15:51,375 DEBUG [rs(jenkins-hbase20.apache.org,44195,1689232541463)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689232549882.5ef6c4ea154e8783e5747813a9d6ca96. completed. 2023-07-13 07:15:51,375 DEBUG [rs(jenkins-hbase20.apache.org,44195,1689232541463)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689232549882.5ef6c4ea154e8783e5747813a9d6ca96. 2023-07-13 07:15:51,375 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-13 07:15:51,375 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-13 07:15:51,375 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:15:51,375 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-13 07:15:51,376 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase20.apache.org,44195,1689232541463' in zk 2023-07-13 07:15:51,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-13 07:15:51,377 DEBUG [rs(jenkins-hbase20.apache.org,42807,1689232541407)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689232549882.619b6fe7e465e5c80c2c088e47805987. completed. 2023-07-13 07:15:51,377 DEBUG [rs(jenkins-hbase20.apache.org,42807,1689232541407)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689232549882.619b6fe7e465e5c80c2c088e47805987. 2023-07-13 07:15:51,377 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-13 07:15:51,377 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-13 07:15:51,377 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:15:51,377 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-13 07:15:51,377 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:15:51,377 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 07:15:51,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:15:51,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 07:15:51,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 07:15:51,379 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-13 07:15:51,377 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-13 07:15:51,377 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-13 07:15:51,379 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase20.apache.org,42807,1689232541407' in zk 2023-07-13 07:15:51,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 07:15:51,379 DEBUG [Listener at jenkins-hbase20.apache.org/34497] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-13 07:15:51,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 07:15:51,380 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-13 07:15:51,380 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:15:51,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-13 07:15:51,380 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 07:15:51,380 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-13 07:15:51,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:15:51,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:15:51,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:15:51,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 07:15:51,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-13 07:15:51,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:15:51,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:15:51,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:15:51,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase20.apache.org,44195,1689232541463': 2023-07-13 07:15:51,384 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44195,1689232541463' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-13 07:15:51,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:15:51,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 07:15:51,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 07:15:51,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 07:15:51,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 07:15:51,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-13 07:15:51,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:15:51,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:15:51,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:15:51,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 07:15:51,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-13 07:15:51,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:15:51,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:15:51,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:15:51,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase20.apache.org,42807,1689232541407': 2023-07-13 07:15:51,388 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,42807,1689232541407' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-13 07:15:51,388 INFO [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-07-13 07:15:51,388 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-13 07:15:51,388 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-13 07:15:51,388 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-07-13 07:15:51,388 INFO [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-13 07:15:51,391 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-13 07:15:51,391 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-13 07:15:51,391 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-13 07:15:51,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-13 07:15:51,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 07:15:51,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 07:15:51,391 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:15:51,391 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-13 07:15:51,391 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-13 07:15:51,391 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-13 07:15:51,391 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:15:51,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-13 07:15:51,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-13 07:15:51,391 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-13 07:15:51,391 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:15:51,391 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:15:51,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-13 07:15:51,392 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:15:51,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:15:51,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 07:15:51,392 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:15:51,392 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:15:51,392 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:15:51,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:15:51,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:15:51,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-13 07:15:51,392 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:15:51,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-13 07:15:51,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-13 07:15:51,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-13 07:15:51,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 07:15:51,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-13 07:15:51,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:15:51,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:15:51,396 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:15:51,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:15:51,397 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:15:51,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 07:15:51,397 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:15:51,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-13 07:15:51,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:15:51,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:15:51,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:15:51,412 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:15:51,412 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:15:51,412 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-13 07:15:51,412 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:15:51,412 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:15:51,412 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:15:51,412 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:15:51,412 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:15:51,413 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 07:15:51,413 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-07-13 07:15:51,413 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:15:51,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:15:51,414 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-07-13 07:15:51,413 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:15:51,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:15:51,412 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:15:51,412 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:15:51,412 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:15:51,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:15:51,414 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-13 07:15:51,414 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:15:51,414 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:15:51,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:15:51,414 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:15:51,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:15:51,414 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:15:51,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:15:51,414 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-13 07:15:51,414 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:15:51,415 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:15:51,415 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-13 07:15:51,415 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-13 07:15:51,416 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-13 07:15:51,456 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-07-13 07:15:51,519 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-13 07:15:51,519 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-13 07:15:51,520 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-13 07:15:51,520 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689232551263Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1689232551414 (+151 ms)Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1689232551414Writing data manifest for emptySnaptb0-testExportWithTargetName at 1689232551425 (+11 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1689232551444 (+19 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689232551519 (+75 ms) 2023-07-13 07:15:51,523 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-13 07:15:51,526 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 258 msec 2023-07-13 07:15:51,579 DEBUG [Listener at jenkins-hbase20.apache.org/34497] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 07:15:51,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-13 07:15:51,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-13 07:15:51,608 DEBUG [htable-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 07:15:51,617 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44195] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1689232549882.5ef6c4ea154e8783e5747813a9d6ca96. with WAL disabled. Data may be lost in the event of a crash. 2023-07-13 07:15:51,619 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:47034, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 07:15:51,620 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42807] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1689232549882.619b6fe7e465e5c80c2c088e47805987. with WAL disabled. Data may be lost in the event of a crash. 2023-07-13 07:15:51,625 DEBUG [Listener at jenkins-hbase20.apache.org/34497] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-13 07:15:51,626 DEBUG [Listener at jenkins-hbase20.apache.org/34497] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1689232549882.619b6fe7e465e5c80c2c088e47805987. 2023-07-13 07:15:51,629 INFO [Listener at jenkins-hbase20.apache.org/34497] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-13 07:15:51,669 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-13 07:15:51,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689232551669 (current time:1689232551669). 2023-07-13 07:15:51,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-13 07:15:51,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] zookeeper.ReadOnlyZKClient(139): Connect 0x097cc20f to 127.0.0.1:58099 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-13 07:15:51,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1257f53f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-13 07:15:51,679 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 07:15:51,683 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:52796, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 07:15:51,684 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x097cc20f to 127.0.0.1:58099 2023-07-13 07:15:51,684 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 07:15:51,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] zookeeper.ReadOnlyZKClient(139): Connect 0x2d61393b to 127.0.0.1:58099 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-13 07:15:51,699 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4262ea22, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-13 07:15:51,701 DEBUG [hconnection-0x6fb1115c-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 07:15:51,705 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:52798, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 07:15:51,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 07:15:51,714 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:37702, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 07:15:51,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2d61393b to 127.0.0.1:58099 2023-07-13 07:15:51,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 07:15:51,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-13 07:15:51,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-13 07:15:51,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-13 07:15:51,719 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-13 07:15:51,721 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-13 07:15:51,722 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689233151722 2023-07-13 07:15:51,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-13 07:15:51,722 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-13 07:15:51,724 DEBUG [Listener at jenkins-hbase20.apache.org/34497] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-13 07:15:51,724 DEBUG [Listener at jenkins-hbase20.apache.org/34497] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-13 07:15:51,724 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1029): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-13 07:15:51,725 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-13 07:15:51,728 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 8 msec 2023-07-13 07:15:51,729 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-13 07:15:51,730 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689233151730 2023-07-13 07:15:51,746 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-07-13 07:15:51,746 INFO [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-07-13 07:15:51,746 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 07:15:51,747 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-07-13 07:15:51,747 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-13 07:15:51,748 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-13 07:15:51,748 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-13 07:15:51,749 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:15:51,749 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:15:51,749 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:15:51,749 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:15:51,749 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:15:51,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:15:51,749 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:15:51,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:15:51,749 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:15:51,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:15:51,750 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:15:51,750 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:15:51,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-13 07:15:51,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-13 07:15:51,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-13 07:15:51,750 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:15:51,750 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-13 07:15:51,750 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-13 07:15:51,750 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-13 07:15:51,750 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-13 07:15:51,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-13 07:15:51,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-13 07:15:51,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-13 07:15:51,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-13 07:15:51,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-13 07:15:51,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-13 07:15:51,751 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-13 07:15:51,751 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-13 07:15:51,751 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-13 07:15:51,751 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-13 07:15:51,751 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-13 07:15:51,751 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 07:15:51,751 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-13 07:15:51,751 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-13 07:15:51,753 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-13 07:15:51,753 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-13 07:15:51,752 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-13 07:15:51,753 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 07:15:51,753 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 07:15:51,754 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-13 07:15:51,753 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-13 07:15:51,755 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-13 07:15:51,755 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44195,1689232541463' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-13 07:15:51,755 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-13 07:15:51,755 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44607,1689232541504' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-13 07:15:51,756 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-13 07:15:51,756 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,42807,1689232541407' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-13 07:15:51,765 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-13 07:15:51,765 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:15:51,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:15:51,765 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:15:51,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 07:15:51,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 07:15:51,765 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-13 07:15:51,765 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-13 07:15:51,766 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-13 07:15:51,766 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 07:15:51,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 07:15:51,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 07:15:51,766 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-13 07:15:51,766 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 07:15:51,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-13 07:15:51,767 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-13 07:15:51,767 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 07:15:51,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:15:51,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:15:51,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:15:51,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 07:15:51,768 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44195,1689232541463' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-13 07:15:51,768 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@74b98bed[Count = 1] remaining members to acquire global barrier 2023-07-13 07:15:51,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:15:51,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 07:15:51,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 07:15:51,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 07:15:51,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 07:15:51,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-13 07:15:51,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:15:51,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:15:51,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:15:51,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 07:15:51,771 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,42807,1689232541407' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-13 07:15:51,771 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@74b98bed[Count = 0] remaining members to acquire global barrier 2023-07-13 07:15:51,771 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-13 07:15:51,771 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-13 07:15:51,774 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-13 07:15:51,774 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-13 07:15:51,774 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-13 07:15:51,774 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-13 07:15:51,774 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-13 07:15:51,775 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:15:51,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-13 07:15:51,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-13 07:15:51,775 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-13 07:15:51,775 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-13 07:15:51,775 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-13 07:15:51,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-13 07:15:51,775 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-13 07:15:51,775 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-13 07:15:51,775 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase20.apache.org,44607,1689232541504' in zk 2023-07-13 07:15:51,775 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-13 07:15:51,775 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-13 07:15:51,775 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:15:51,775 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-13 07:15:51,775 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-13 07:15:51,775 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-13 07:15:51,776 DEBUG [rs(jenkins-hbase20.apache.org,42807,1689232541407)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689232549882.619b6fe7e465e5c80c2c088e47805987. 2023-07-13 07:15:51,775 DEBUG [rs(jenkins-hbase20.apache.org,44195,1689232541463)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689232549882.5ef6c4ea154e8783e5747813a9d6ca96. 2023-07-13 07:15:51,776 DEBUG [rs(jenkins-hbase20.apache.org,42807,1689232541407)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689232549882.619b6fe7e465e5c80c2c088e47805987. started... 2023-07-13 07:15:51,776 DEBUG [rs(jenkins-hbase20.apache.org,44195,1689232541463)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689232549882.5ef6c4ea154e8783e5747813a9d6ca96. started... 2023-07-13 07:15:51,776 INFO [rs(jenkins-hbase20.apache.org,42807,1689232541407)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 619b6fe7e465e5c80c2c088e47805987 1/1 column families, dataSize=132 B heapSize=544 B 2023-07-13 07:15:51,776 INFO [rs(jenkins-hbase20.apache.org,44195,1689232541463)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 5ef6c4ea154e8783e5747813a9d6ca96 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-07-13 07:15:51,779 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-13 07:15:51,779 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 07:15:51,779 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-13 07:15:51,824 DEBUG [Listener at jenkins-hbase20.apache.org/34497] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 07:15:51,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-13 07:15:51,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-13 07:15:51,826 DEBUG [Listener at jenkins-hbase20.apache.org/34497] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-13 07:15:51,988 INFO [rs(jenkins-hbase20.apache.org,42807,1689232541407)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=132 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testExportWithTargetName/619b6fe7e465e5c80c2c088e47805987/.tmp/cf/b55396181d0a47128ee6024e068303be 2023-07-13 07:15:51,995 INFO [rs(jenkins-hbase20.apache.org,44195,1689232541463)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.13 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testExportWithTargetName/5ef6c4ea154e8783e5747813a9d6ca96/.tmp/cf/0667f8b079004d50b362b77116f3fd77 2023-07-13 07:15:52,026 DEBUG [Listener at jenkins-hbase20.apache.org/34497] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 07:15:52,028 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-13 07:15:52,028 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-13 07:15:52,028 DEBUG [Listener at jenkins-hbase20.apache.org/34497] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-13 07:15:52,041 DEBUG [rs(jenkins-hbase20.apache.org,44195,1689232541463)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testExportWithTargetName/5ef6c4ea154e8783e5747813a9d6ca96/.tmp/cf/0667f8b079004d50b362b77116f3fd77 as hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testExportWithTargetName/5ef6c4ea154e8783e5747813a9d6ca96/cf/0667f8b079004d50b362b77116f3fd77 2023-07-13 07:15:52,042 DEBUG [rs(jenkins-hbase20.apache.org,42807,1689232541407)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testExportWithTargetName/619b6fe7e465e5c80c2c088e47805987/.tmp/cf/b55396181d0a47128ee6024e068303be as hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testExportWithTargetName/619b6fe7e465e5c80c2c088e47805987/cf/b55396181d0a47128ee6024e068303be 2023-07-13 07:15:52,055 INFO [rs(jenkins-hbase20.apache.org,42807,1689232541407)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testExportWithTargetName/619b6fe7e465e5c80c2c088e47805987/cf/b55396181d0a47128ee6024e068303be, entries=2, sequenceid=6, filesize=5.0 K 2023-07-13 07:15:52,058 INFO [rs(jenkins-hbase20.apache.org,42807,1689232541407)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for 619b6fe7e465e5c80c2c088e47805987 in 281ms, sequenceid=6, compaction requested=false 2023-07-13 07:15:52,058 DEBUG [rs(jenkins-hbase20.apache.org,42807,1689232541407)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-13 07:15:52,059 DEBUG [rs(jenkins-hbase20.apache.org,42807,1689232541407)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 619b6fe7e465e5c80c2c088e47805987: 2023-07-13 07:15:52,060 DEBUG [rs(jenkins-hbase20.apache.org,42807,1689232541407)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689232549882.619b6fe7e465e5c80c2c088e47805987.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-13 07:15:52,060 DEBUG [rs(jenkins-hbase20.apache.org,42807,1689232541407)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-13 07:15:52,060 DEBUG [rs(jenkins-hbase20.apache.org,42807,1689232541407)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testExportWithTargetName/619b6fe7e465e5c80c2c088e47805987/cf/b55396181d0a47128ee6024e068303be] hfiles 2023-07-13 07:15:52,060 DEBUG [rs(jenkins-hbase20.apache.org,42807,1689232541407)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testExportWithTargetName/619b6fe7e465e5c80c2c088e47805987/cf/b55396181d0a47128ee6024e068303be for snapshot=snaptb0-testExportWithTargetName 2023-07-13 07:15:52,061 INFO [rs(jenkins-hbase20.apache.org,44195,1689232541463)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testExportWithTargetName/5ef6c4ea154e8783e5747813a9d6ca96/cf/0667f8b079004d50b362b77116f3fd77, entries=48, sequenceid=6, filesize=8.1 K 2023-07-13 07:15:52,065 INFO [rs(jenkins-hbase20.apache.org,44195,1689232541463)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for 5ef6c4ea154e8783e5747813a9d6ca96 in 289ms, sequenceid=6, compaction requested=false 2023-07-13 07:15:52,067 DEBUG [rs(jenkins-hbase20.apache.org,44195,1689232541463)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5ef6c4ea154e8783e5747813a9d6ca96: 2023-07-13 07:15:52,068 DEBUG [rs(jenkins-hbase20.apache.org,44195,1689232541463)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689232549882.5ef6c4ea154e8783e5747813a9d6ca96.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-13 07:15:52,068 DEBUG [rs(jenkins-hbase20.apache.org,44195,1689232541463)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-13 07:15:52,068 DEBUG [rs(jenkins-hbase20.apache.org,44195,1689232541463)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testExportWithTargetName/5ef6c4ea154e8783e5747813a9d6ca96/cf/0667f8b079004d50b362b77116f3fd77] hfiles 2023-07-13 07:15:52,068 DEBUG [rs(jenkins-hbase20.apache.org,44195,1689232541463)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testExportWithTargetName/5ef6c4ea154e8783e5747813a9d6ca96/cf/0667f8b079004d50b362b77116f3fd77 for snapshot=snaptb0-testExportWithTargetName 2023-07-13 07:15:52,104 DEBUG [rs(jenkins-hbase20.apache.org,44195,1689232541463)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689232549882.5ef6c4ea154e8783e5747813a9d6ca96. completed. 2023-07-13 07:15:52,104 DEBUG [rs(jenkins-hbase20.apache.org,44195,1689232541463)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689232549882.5ef6c4ea154e8783e5747813a9d6ca96. 2023-07-13 07:15:52,105 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-13 07:15:52,105 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-13 07:15:52,105 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:15:52,105 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-13 07:15:52,105 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase20.apache.org,44195,1689232541463' in zk 2023-07-13 07:15:52,106 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:15:52,106 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-13 07:15:52,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:15:52,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 07:15:52,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 07:15:52,106 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 07:15:52,106 DEBUG [rs(jenkins-hbase20.apache.org,42807,1689232541407)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689232549882.619b6fe7e465e5c80c2c088e47805987. completed. 2023-07-13 07:15:52,107 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-13 07:15:52,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 07:15:52,108 DEBUG [rs(jenkins-hbase20.apache.org,42807,1689232541407)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689232549882.619b6fe7e465e5c80c2c088e47805987. 2023-07-13 07:15:52,109 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-13 07:15:52,109 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-13 07:15:52,109 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:15:52,109 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-13 07:15:52,109 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase20.apache.org,42807,1689232541407' in zk 2023-07-13 07:15:52,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 07:15:52,111 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-13 07:15:52,111 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 07:15:52,111 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-13 07:15:52,111 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:15:52,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-13 07:15:52,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:15:52,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:15:52,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:15:52,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 07:15:52,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-13 07:15:52,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:15:52,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:15:52,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:15:52,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase20.apache.org,44195,1689232541463': 2023-07-13 07:15:52,115 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44195,1689232541463' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-13 07:15:52,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:15:52,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 07:15:52,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 07:15:52,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 07:15:52,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 07:15:52,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-13 07:15:52,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:15:52,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:15:52,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:15:52,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 07:15:52,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-13 07:15:52,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:15:52,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:15:52,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:15:52,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase20.apache.org,42807,1689232541407': 2023-07-13 07:15:52,124 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,42807,1689232541407' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-13 07:15:52,124 INFO [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-07-13 07:15:52,124 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-13 07:15:52,124 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-13 07:15:52,124 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-07-13 07:15:52,124 INFO [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-13 07:15:52,128 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-13 07:15:52,128 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-13 07:15:52,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-13 07:15:52,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 07:15:52,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 07:15:52,128 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-13 07:15:52,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-13 07:15:52,128 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-13 07:15:52,128 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:15:52,128 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-13 07:15:52,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-13 07:15:52,128 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:15:52,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 07:15:52,129 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:15:52,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:15:52,129 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:15:52,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:15:52,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-13 07:15:52,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-13 07:15:52,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 07:15:52,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-13 07:15:52,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-13 07:15:52,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:15:52,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:15:52,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:15:52,130 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-13 07:15:52,130 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:15:52,130 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-13 07:15:52,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-13 07:15:52,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 07:15:52,131 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:15:52,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:15:52,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-13 07:15:52,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-13 07:15:52,131 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:15:52,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:15:52,132 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:15:52,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:15:52,132 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:15:52,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:15:52,138 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:15:52,138 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:15:52,139 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:15:52,153 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:15:52,153 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-13 07:15:52,153 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:15:52,153 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:15:52,153 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:15:52,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:15:52,153 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:15:52,153 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:15:52,153 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:15:52,153 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:15:52,153 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:15:52,153 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-07-13 07:15:52,153 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 07:15:52,154 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-07-13 07:15:52,154 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:15:52,153 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:15:52,153 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:15:52,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:15:52,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:15:52,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:15:52,153 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-13 07:15:52,156 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:15:52,156 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-13 07:15:52,156 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:15:52,156 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:15:52,156 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-13 07:15:52,156 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-13 07:15:52,156 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:15:52,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:15:52,153 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:15:52,156 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:15:52,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:15:52,157 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-13 07:15:52,204 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-13 07:15:52,249 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-13 07:15:52,249 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-13 07:15:52,249 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-13 07:15:52,249 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689232551722Consolidate snapshot: snaptb0-testExportWithTargetName at 1689232552154 (+432 ms)Loading Region manifests for snaptb0-testExportWithTargetName at 1689232552155 (+1 ms)Writing data manifest for snaptb0-testExportWithTargetName at 1689232552173 (+18 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1689232552194 (+21 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689232552249 (+55 ms) 2023-07-13 07:15:52,252 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-13 07:15:52,254 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 529 msec 2023-07-13 07:15:52,329 DEBUG [Listener at jenkins-hbase20.apache.org/34497] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 07:15:52,333 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-13 07:15:52,333 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-13 07:15:52,334 INFO [Listener at jenkins-hbase20.apache.org/34497] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/export-test/export-1689232552333 2023-07-13 07:15:52,334 INFO [Listener at jenkins-hbase20.apache.org/34497] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost.localdomain:40681, tgtDir=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/export-test/export-1689232552333, rawTgtDir=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/export-test/export-1689232552333, srcFsUri=hdfs://localhost.localdomain:40681, srcDir=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e 2023-07-13 07:15:52,377 DEBUG [Listener at jenkins-hbase20.apache.org/34497] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost.localdomain:40681, inputRoot=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e 2023-07-13 07:15:52,377 DEBUG [Listener at jenkins-hbase20.apache.org/34497] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_589013729_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/export-test/export-1689232552333, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/export-test/export-1689232552333/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-13 07:15:52,377 INFO [Listener at jenkins-hbase20.apache.org/34497] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost.localdomain:40681, inputRoot=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e, snapshotDir=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-07-13 07:15:52,395 INFO [Listener at jenkins-hbase20.apache.org/34497] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/export-test/export-1689232552333/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-13 07:15:52,927 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-13 07:15:52,928 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-13 07:15:52,929 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-13 07:15:52,930 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-13 07:15:52,930 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-13 07:15:52,931 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-13 07:15:52,931 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-13 07:15:53,010 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a827846-4542-2630-0c34-c6bc20d13d68/hadoop-1132881294925271269.jar 2023-07-13 07:15:53,011 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-13 07:15:53,011 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-13 07:15:53,012 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-13 07:15:53,012 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-13 07:15:53,013 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-13 07:15:53,014 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-13 07:15:53,014 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-13 07:15:53,015 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-13 07:15:53,016 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-13 07:15:53,016 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-13 07:15:53,017 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-13 07:15:53,018 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-13 07:15:53,018 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-13 07:15:53,019 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-13 07:15:53,019 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-13 07:15:53,020 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-13 07:15:53,023 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-13 07:15:53,024 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-13 07:15:53,024 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-13 07:15:53,025 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-13 07:15:53,025 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-13 07:15:53,026 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-13 07:15:53,026 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-13 07:15:55,243 WARN [Listener at jenkins-hbase20.apache.org/34497] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-13 07:15:55,251 INFO [Listener at jenkins-hbase20.apache.org/34497] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-07-13 07:15:55,265 DEBUG [Listener at jenkins-hbase20.apache.org/34497] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-13 07:15:55,923 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-13 07:15:56,073 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-13 07:15:56,073 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-13 07:15:56,456 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689232548306_0001_000001 (auth:SIMPLE) 2023-07-13 07:16:01,828 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689232548306_0001_000001 (auth:SIMPLE) 2023-07-13 07:16:04,128 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689232548306_0001_000001 (auth:SIMPLE) 2023-07-13 07:16:07,216 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689232548306_0001_000001 (auth:SIMPLE) 2023-07-13 07:16:08,459 INFO [Listener at jenkins-hbase20.apache.org/34497] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-13 07:16:08,466 INFO [Listener at jenkins-hbase20.apache.org/34497] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-13 07:16:08,499 INFO [Listener at jenkins-hbase20.apache.org/34497] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-07-13 07:16:08,499 INFO [Listener at jenkins-hbase20.apache.org/34497] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-13 07:16:08,500 INFO [Listener at jenkins-hbase20.apache.org/34497] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-13 07:16:08,501 DEBUG [Listener at jenkins-hbase20.apache.org/34497] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_139625932_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-13 07:16:08,502 DEBUG [Listener at jenkins-hbase20.apache.org/34497] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-07-13 07:16:08,502 DEBUG [Listener at jenkins-hbase20.apache.org/34497] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-07-13 07:16:08,503 DEBUG [Listener at jenkins-hbase20.apache.org/34497] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_139625932_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/export-test/export-1689232552333/.hbase-snapshot/testExportWithTargetName at hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/export-test/export-1689232552333/.hbase-snapshot/testExportWithTargetName 2023-07-13 07:16:08,504 DEBUG [Listener at jenkins-hbase20.apache.org/34497] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/export-test/export-1689232552333/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-07-13 07:16:08,504 DEBUG [Listener at jenkins-hbase20.apache.org/34497] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/export-test/export-1689232552333/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-07-13 07:16:08,521 INFO [Listener at jenkins-hbase20.apache.org/34497] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-07-13 07:16:08,527 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testtb-testExportWithTargetName 2023-07-13 07:16:08,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] procedure2.ProcedureExecutor(1029): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-07-13 07:16:08,540 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689232568540"}]},"ts":"1689232568540"} 2023-07-13 07:16:08,541 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-13 07:16:08,542 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-07-13 07:16:08,543 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-07-13 07:16:08,546 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=619b6fe7e465e5c80c2c088e47805987, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=5ef6c4ea154e8783e5747813a9d6ca96, UNASSIGN}] 2023-07-13 07:16:08,549 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=619b6fe7e465e5c80c2c088e47805987, UNASSIGN 2023-07-13 07:16:08,549 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=5ef6c4ea154e8783e5747813a9d6ca96, UNASSIGN 2023-07-13 07:16:08,550 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=619b6fe7e465e5c80c2c088e47805987, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:16:08,550 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=5ef6c4ea154e8783e5747813a9d6ca96, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:16:08,551 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689232549882.619b6fe7e465e5c80c2c088e47805987.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689232568550"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689232568550"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689232568550"}]},"ts":"1689232568550"} 2023-07-13 07:16:08,551 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689232549882.5ef6c4ea154e8783e5747813a9d6ca96.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689232568550"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689232568550"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689232568550"}]},"ts":"1689232568550"} 2023-07-13 07:16:08,553 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=22, state=RUNNABLE; CloseRegionProcedure 619b6fe7e465e5c80c2c088e47805987, server=jenkins-hbase20.apache.org,42807,1689232541407}] 2023-07-13 07:16:08,553 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=23, state=RUNNABLE; CloseRegionProcedure 5ef6c4ea154e8783e5747813a9d6ca96, server=jenkins-hbase20.apache.org,44195,1689232541463}] 2023-07-13 07:16:08,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-13 07:16:08,717 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 5ef6c4ea154e8783e5747813a9d6ca96 2023-07-13 07:16:08,717 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 619b6fe7e465e5c80c2c088e47805987 2023-07-13 07:16:08,717 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 5ef6c4ea154e8783e5747813a9d6ca96, disabling compactions & flushes 2023-07-13 07:16:08,717 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 619b6fe7e465e5c80c2c088e47805987, disabling compactions & flushes 2023-07-13 07:16:08,717 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689232549882.5ef6c4ea154e8783e5747813a9d6ca96. 2023-07-13 07:16:08,717 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689232549882.619b6fe7e465e5c80c2c088e47805987. 2023-07-13 07:16:08,717 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689232549882.5ef6c4ea154e8783e5747813a9d6ca96. 2023-07-13 07:16:08,717 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689232549882.619b6fe7e465e5c80c2c088e47805987. 2023-07-13 07:16:08,717 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689232549882.5ef6c4ea154e8783e5747813a9d6ca96. after waiting 0 ms 2023-07-13 07:16:08,717 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689232549882.619b6fe7e465e5c80c2c088e47805987. after waiting 0 ms 2023-07-13 07:16:08,717 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689232549882.5ef6c4ea154e8783e5747813a9d6ca96. 2023-07-13 07:16:08,717 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689232549882.619b6fe7e465e5c80c2c088e47805987. 2023-07-13 07:16:08,735 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testExportWithTargetName/5ef6c4ea154e8783e5747813a9d6ca96/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-13 07:16:08,735 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testExportWithTargetName/619b6fe7e465e5c80c2c088e47805987/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-13 07:16:08,735 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-13 07:16:08,735 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-13 07:16:08,737 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689232549882.5ef6c4ea154e8783e5747813a9d6ca96. 2023-07-13 07:16:08,737 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689232549882.619b6fe7e465e5c80c2c088e47805987. 2023-07-13 07:16:08,737 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 5ef6c4ea154e8783e5747813a9d6ca96: 2023-07-13 07:16:08,737 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 619b6fe7e465e5c80c2c088e47805987: 2023-07-13 07:16:08,740 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 5ef6c4ea154e8783e5747813a9d6ca96 2023-07-13 07:16:08,740 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=5ef6c4ea154e8783e5747813a9d6ca96, regionState=CLOSED 2023-07-13 07:16:08,740 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 619b6fe7e465e5c80c2c088e47805987 2023-07-13 07:16:08,741 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689232549882.5ef6c4ea154e8783e5747813a9d6ca96.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689232568740"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689232568740"}]},"ts":"1689232568740"} 2023-07-13 07:16:08,741 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=619b6fe7e465e5c80c2c088e47805987, regionState=CLOSED 2023-07-13 07:16:08,741 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689232549882.619b6fe7e465e5c80c2c088e47805987.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689232568741"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689232568741"}]},"ts":"1689232568741"} 2023-07-13 07:16:08,745 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=23 2023-07-13 07:16:08,745 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=23, state=SUCCESS; CloseRegionProcedure 5ef6c4ea154e8783e5747813a9d6ca96, server=jenkins-hbase20.apache.org,44195,1689232541463 in 189 msec 2023-07-13 07:16:08,746 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=22 2023-07-13 07:16:08,746 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=22, state=SUCCESS; CloseRegionProcedure 619b6fe7e465e5c80c2c088e47805987, server=jenkins-hbase20.apache.org,42807,1689232541407 in 190 msec 2023-07-13 07:16:08,747 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=5ef6c4ea154e8783e5747813a9d6ca96, UNASSIGN in 199 msec 2023-07-13 07:16:08,748 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=21 2023-07-13 07:16:08,748 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=619b6fe7e465e5c80c2c088e47805987, UNASSIGN in 201 msec 2023-07-13 07:16:08,749 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689232568749"}]},"ts":"1689232568749"} 2023-07-13 07:16:08,755 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-07-13 07:16:08,756 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-07-13 07:16:08,760 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 226 msec 2023-07-13 07:16:08,844 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-13 07:16:08,845 INFO [Listener at jenkins-hbase20.apache.org/34497] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-07-13 07:16:08,850 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.HMaster$5(2228): Client=jenkins//148.251.75.209 delete testtb-testExportWithTargetName 2023-07-13 07:16:08,858 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-13 07:16:08,862 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-13 07:16:08,863 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-07-13 07:16:08,864 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-13 07:16:08,867 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44607] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-07-13 07:16:08,868 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-13 07:16:08,868 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-13 07:16:08,868 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-13 07:16:08,868 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-13 07:16:08,869 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 07:16:08,869 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 07:16:08,869 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 07:16:08,869 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 07:16:08,870 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testExportWithTargetName/619b6fe7e465e5c80c2c088e47805987 2023-07-13 07:16:08,870 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-13 07:16:08,870 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testExportWithTargetName/5ef6c4ea154e8783e5747813a9d6ca96 2023-07-13 07:16:08,870 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-13 07:16:08,870 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-13 07:16:08,870 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-13 07:16:08,870 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-13 07:16:08,870 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-13 07:16:08,870 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-13 07:16:08,870 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-13 07:16:08,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-13 07:16:08,873 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testExportWithTargetName/5ef6c4ea154e8783e5747813a9d6ca96/cf, FileablePath, hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testExportWithTargetName/5ef6c4ea154e8783e5747813a9d6ca96/recovered.edits] 2023-07-13 07:16:08,873 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testExportWithTargetName/619b6fe7e465e5c80c2c088e47805987/cf, FileablePath, hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testExportWithTargetName/619b6fe7e465e5c80c2c088e47805987/recovered.edits] 2023-07-13 07:16:08,880 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testExportWithTargetName/5ef6c4ea154e8783e5747813a9d6ca96/cf/0667f8b079004d50b362b77116f3fd77 to hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/archive/data/default/testtb-testExportWithTargetName/5ef6c4ea154e8783e5747813a9d6ca96/cf/0667f8b079004d50b362b77116f3fd77 2023-07-13 07:16:08,880 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testExportWithTargetName/619b6fe7e465e5c80c2c088e47805987/cf/b55396181d0a47128ee6024e068303be to hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/archive/data/default/testtb-testExportWithTargetName/619b6fe7e465e5c80c2c088e47805987/cf/b55396181d0a47128ee6024e068303be 2023-07-13 07:16:08,884 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testExportWithTargetName/5ef6c4ea154e8783e5747813a9d6ca96/recovered.edits/9.seqid to hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/archive/data/default/testtb-testExportWithTargetName/5ef6c4ea154e8783e5747813a9d6ca96/recovered.edits/9.seqid 2023-07-13 07:16:08,885 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testExportWithTargetName/619b6fe7e465e5c80c2c088e47805987/recovered.edits/9.seqid to hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/archive/data/default/testtb-testExportWithTargetName/619b6fe7e465e5c80c2c088e47805987/recovered.edits/9.seqid 2023-07-13 07:16:08,887 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testExportWithTargetName/5ef6c4ea154e8783e5747813a9d6ca96 2023-07-13 07:16:08,887 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testExportWithTargetName/619b6fe7e465e5c80c2c088e47805987 2023-07-13 07:16:08,887 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-13 07:16:08,890 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-13 07:16:08,910 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-07-13 07:16:08,913 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-07-13 07:16:08,915 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-13 07:16:08,915 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-07-13 07:16:08,915 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1689232549882.619b6fe7e465e5c80c2c088e47805987.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689232568915"}]},"ts":"9223372036854775807"} 2023-07-13 07:16:08,915 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1689232549882.5ef6c4ea154e8783e5747813a9d6ca96.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689232568915"}]},"ts":"9223372036854775807"} 2023-07-13 07:16:08,918 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-13 07:16:08,918 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 619b6fe7e465e5c80c2c088e47805987, NAME => 'testtb-testExportWithTargetName,,1689232549882.619b6fe7e465e5c80c2c088e47805987.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 5ef6c4ea154e8783e5747813a9d6ca96, NAME => 'testtb-testExportWithTargetName,1,1689232549882.5ef6c4ea154e8783e5747813a9d6ca96.', STARTKEY => '1', ENDKEY => ''}] 2023-07-13 07:16:08,918 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-07-13 07:16:08,919 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689232568919"}]},"ts":"9223372036854775807"} 2023-07-13 07:16:08,921 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-07-13 07:16:08,923 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-13 07:16:08,925 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 72 msec 2023-07-13 07:16:08,975 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-13 07:16:08,976 INFO [Listener at jenkins-hbase20.apache.org/34497] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-07-13 07:16:09,001 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "emptySnaptb0-testExportWithTargetName" 2023-07-13 07:16:09,005 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-07-13 07:16:09,008 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "snaptb0-testExportWithTargetName" 2023-07-13 07:16:09,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-07-13 07:16:09,053 INFO [Listener at jenkins-hbase20.apache.org/34497] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportWithTargetName Thread=756 (was 708) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a827846-4542-2630-0c34-c6bc20d13d68/cluster_bc2fa478-0401-934d-1612-4dd95a9869a4/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0xd7981d0-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a827846-4542-2630-0c34-c6bc20d13d68/cluster_bc2fa478-0401-934d-1612-4dd95a9869a4/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (788891943) connection to jenkins-hbase20.apache.org/148.251.75.209:45319 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a827846-4542-2630-0c34-c6bc20d13d68/cluster_bc2fa478-0401-934d-1612-4dd95a9869a4/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0xd7981d0-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a827846-4542-2630-0c34-c6bc20d13d68/cluster_bc2fa478-0401-934d-1612-4dd95a9869a4/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_139625932_17 at /127.0.0.1:32982 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-259365134_1 at /127.0.0.1:32962 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0xd7981d0-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-259365134_1 at /127.0.0.1:48328 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a827846-4542-2630-0c34-c6bc20d13d68/cluster_bc2fa478-0401-934d-1612-4dd95a9869a4/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a827846-4542-2630-0c34-c6bc20d13d68/cluster_bc2fa478-0401-934d-1612-4dd95a9869a4/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0xd7981d0-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_139625932_17 at /127.0.0.1:48362 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1282 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_139625932_17 at /127.0.0.1:40152 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (788891943) connection to jenkins-hbase20.apache.org/148.251.75.209:38439 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (788891943) connection to jenkins-hbase20.apache.org/148.251.75.209:46533 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=922 (was 902) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=454 (was 468), ProcessCount=169 (was 168) - ProcessCount LEAK? -, AvailableMemoryMB=3697 (was 3324) - AvailableMemoryMB LEAK? - 2023-07-13 07:16:09,053 WARN [Listener at jenkins-hbase20.apache.org/34497] hbase.ResourceChecker(130): Thread=756 is superior to 500 2023-07-13 07:16:09,075 INFO [Listener at jenkins-hbase20.apache.org/34497] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemState Thread=756, OpenFileDescriptor=922, MaxFileDescriptor=60000, SystemLoadAverage=454, ProcessCount=169, AvailableMemoryMB=3696 2023-07-13 07:16:09,076 WARN [Listener at jenkins-hbase20.apache.org/34497] hbase.ResourceChecker(130): Thread=756 is superior to 500 2023-07-13 07:16:09,078 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-13 07:16:09,081 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-07-13 07:16:09,084 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-13 07:16:09,084 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-07-13 07:16:09,086 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-13 07:16:09,086 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-13 07:16:09,089 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testExportFileSystemState/0b04412d88ddbb268620c7618999ffba 2023-07-13 07:16:09,089 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testExportFileSystemState/6036d7d0cdc0eb7405c01836151306ae 2023-07-13 07:16:09,089 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testExportFileSystemState/6036d7d0cdc0eb7405c01836151306ae empty. 2023-07-13 07:16:09,089 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testExportFileSystemState/0b04412d88ddbb268620c7618999ffba empty. 2023-07-13 07:16:09,090 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testExportFileSystemState/6036d7d0cdc0eb7405c01836151306ae 2023-07-13 07:16:09,090 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testExportFileSystemState/0b04412d88ddbb268620c7618999ffba 2023-07-13 07:16:09,090 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-13 07:16:09,112 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-13 07:16:09,113 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 0b04412d88ddbb268620c7618999ffba, NAME => 'testtb-testExportFileSystemState,,1689232569078.0b04412d88ddbb268620c7618999ffba.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp 2023-07-13 07:16:09,113 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 6036d7d0cdc0eb7405c01836151306ae, NAME => 'testtb-testExportFileSystemState,1,1689232569078.6036d7d0cdc0eb7405c01836151306ae.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp 2023-07-13 07:16:09,148 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689232569078.0b04412d88ddbb268620c7618999ffba.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 07:16:09,149 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 0b04412d88ddbb268620c7618999ffba, disabling compactions & flushes 2023-07-13 07:16:09,150 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689232569078.0b04412d88ddbb268620c7618999ffba. 2023-07-13 07:16:09,150 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689232569078.0b04412d88ddbb268620c7618999ffba. 2023-07-13 07:16:09,150 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689232569078.0b04412d88ddbb268620c7618999ffba. after waiting 0 ms 2023-07-13 07:16:09,150 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689232569078.0b04412d88ddbb268620c7618999ffba. 2023-07-13 07:16:09,150 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689232569078.0b04412d88ddbb268620c7618999ffba. 2023-07-13 07:16:09,150 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 0b04412d88ddbb268620c7618999ffba: 2023-07-13 07:16:09,150 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689232569078.6036d7d0cdc0eb7405c01836151306ae.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 07:16:09,151 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 6036d7d0cdc0eb7405c01836151306ae, disabling compactions & flushes 2023-07-13 07:16:09,151 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689232569078.6036d7d0cdc0eb7405c01836151306ae. 2023-07-13 07:16:09,151 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689232569078.6036d7d0cdc0eb7405c01836151306ae. 2023-07-13 07:16:09,151 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689232569078.6036d7d0cdc0eb7405c01836151306ae. after waiting 0 ms 2023-07-13 07:16:09,151 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689232569078.6036d7d0cdc0eb7405c01836151306ae. 2023-07-13 07:16:09,151 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689232569078.6036d7d0cdc0eb7405c01836151306ae. 2023-07-13 07:16:09,152 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 6036d7d0cdc0eb7405c01836151306ae: 2023-07-13 07:16:09,163 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-13 07:16:09,166 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689232569078.0b04412d88ddbb268620c7618999ffba.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689232569165"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689232569165"}]},"ts":"1689232569165"} 2023-07-13 07:16:09,166 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689232569078.6036d7d0cdc0eb7405c01836151306ae.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689232569165"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689232569165"}]},"ts":"1689232569165"} 2023-07-13 07:16:09,170 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-13 07:16:09,171 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-13 07:16:09,171 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689232569171"}]},"ts":"1689232569171"} 2023-07-13 07:16:09,174 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-07-13 07:16:09,176 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-07-13 07:16:09,177 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-13 07:16:09,177 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-13 07:16:09,178 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-13 07:16:09,178 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-13 07:16:09,178 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=0b04412d88ddbb268620c7618999ffba, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6036d7d0cdc0eb7405c01836151306ae, ASSIGN}] 2023-07-13 07:16:09,181 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=0b04412d88ddbb268620c7618999ffba, ASSIGN 2023-07-13 07:16:09,181 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6036d7d0cdc0eb7405c01836151306ae, ASSIGN 2023-07-13 07:16:09,182 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=0b04412d88ddbb268620c7618999ffba, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,42807,1689232541407; forceNewPlan=false, retain=false 2023-07-13 07:16:09,182 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6036d7d0cdc0eb7405c01836151306ae, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,44195,1689232541463; forceNewPlan=false, retain=false 2023-07-13 07:16:09,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-13 07:16:09,332 INFO [jenkins-hbase20:37475] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-13 07:16:09,336 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=6036d7d0cdc0eb7405c01836151306ae, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:16:09,336 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689232569078.6036d7d0cdc0eb7405c01836151306ae.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689232569335"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689232569335"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689232569335"}]},"ts":"1689232569335"} 2023-07-13 07:16:09,336 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=0b04412d88ddbb268620c7618999ffba, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:16:09,337 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689232569078.0b04412d88ddbb268620c7618999ffba.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689232569336"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689232569336"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689232569336"}]},"ts":"1689232569336"} 2023-07-13 07:16:09,341 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=29, state=RUNNABLE; OpenRegionProcedure 6036d7d0cdc0eb7405c01836151306ae, server=jenkins-hbase20.apache.org,44195,1689232541463}] 2023-07-13 07:16:09,343 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=28, state=RUNNABLE; OpenRegionProcedure 0b04412d88ddbb268620c7618999ffba, server=jenkins-hbase20.apache.org,42807,1689232541407}] 2023-07-13 07:16:09,390 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-13 07:16:09,499 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1689232569078.6036d7d0cdc0eb7405c01836151306ae. 2023-07-13 07:16:09,499 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6036d7d0cdc0eb7405c01836151306ae, NAME => 'testtb-testExportFileSystemState,1,1689232569078.6036d7d0cdc0eb7405c01836151306ae.', STARTKEY => '1', ENDKEY => ''} 2023-07-13 07:16:09,499 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1689232569078.6036d7d0cdc0eb7405c01836151306ae. service=AccessControlService 2023-07-13 07:16:09,500 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-13 07:16:09,500 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 6036d7d0cdc0eb7405c01836151306ae 2023-07-13 07:16:09,500 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689232569078.6036d7d0cdc0eb7405c01836151306ae.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 07:16:09,500 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 6036d7d0cdc0eb7405c01836151306ae 2023-07-13 07:16:09,500 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 6036d7d0cdc0eb7405c01836151306ae 2023-07-13 07:16:09,502 INFO [StoreOpener-6036d7d0cdc0eb7405c01836151306ae-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 6036d7d0cdc0eb7405c01836151306ae 2023-07-13 07:16:09,503 DEBUG [StoreOpener-6036d7d0cdc0eb7405c01836151306ae-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testExportFileSystemState/6036d7d0cdc0eb7405c01836151306ae/cf 2023-07-13 07:16:09,503 DEBUG [StoreOpener-6036d7d0cdc0eb7405c01836151306ae-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testExportFileSystemState/6036d7d0cdc0eb7405c01836151306ae/cf 2023-07-13 07:16:09,503 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1689232569078.0b04412d88ddbb268620c7618999ffba. 2023-07-13 07:16:09,504 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0b04412d88ddbb268620c7618999ffba, NAME => 'testtb-testExportFileSystemState,,1689232569078.0b04412d88ddbb268620c7618999ffba.', STARTKEY => '', ENDKEY => '1'} 2023-07-13 07:16:09,504 INFO [StoreOpener-6036d7d0cdc0eb7405c01836151306ae-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6036d7d0cdc0eb7405c01836151306ae columnFamilyName cf 2023-07-13 07:16:09,504 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1689232569078.0b04412d88ddbb268620c7618999ffba. service=AccessControlService 2023-07-13 07:16:09,504 INFO [StoreOpener-6036d7d0cdc0eb7405c01836151306ae-1] regionserver.HStore(310): Store=6036d7d0cdc0eb7405c01836151306ae/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-13 07:16:09,506 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-13 07:16:09,506 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 0b04412d88ddbb268620c7618999ffba 2023-07-13 07:16:09,506 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689232569078.0b04412d88ddbb268620c7618999ffba.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 07:16:09,506 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 0b04412d88ddbb268620c7618999ffba 2023-07-13 07:16:09,506 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 0b04412d88ddbb268620c7618999ffba 2023-07-13 07:16:09,507 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testExportFileSystemState/6036d7d0cdc0eb7405c01836151306ae 2023-07-13 07:16:09,507 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testExportFileSystemState/6036d7d0cdc0eb7405c01836151306ae 2023-07-13 07:16:09,508 INFO [StoreOpener-0b04412d88ddbb268620c7618999ffba-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 0b04412d88ddbb268620c7618999ffba 2023-07-13 07:16:09,512 DEBUG [StoreOpener-0b04412d88ddbb268620c7618999ffba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testExportFileSystemState/0b04412d88ddbb268620c7618999ffba/cf 2023-07-13 07:16:09,512 DEBUG [StoreOpener-0b04412d88ddbb268620c7618999ffba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testExportFileSystemState/0b04412d88ddbb268620c7618999ffba/cf 2023-07-13 07:16:09,512 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 6036d7d0cdc0eb7405c01836151306ae 2023-07-13 07:16:09,512 INFO [StoreOpener-0b04412d88ddbb268620c7618999ffba-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0b04412d88ddbb268620c7618999ffba columnFamilyName cf 2023-07-13 07:16:09,513 INFO [StoreOpener-0b04412d88ddbb268620c7618999ffba-1] regionserver.HStore(310): Store=0b04412d88ddbb268620c7618999ffba/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-13 07:16:09,514 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testExportFileSystemState/0b04412d88ddbb268620c7618999ffba 2023-07-13 07:16:09,516 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testExportFileSystemState/6036d7d0cdc0eb7405c01836151306ae/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-13 07:16:09,516 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testExportFileSystemState/0b04412d88ddbb268620c7618999ffba 2023-07-13 07:16:09,516 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 6036d7d0cdc0eb7405c01836151306ae; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64318554, jitterRate=-0.041578859090805054}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-13 07:16:09,516 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 6036d7d0cdc0eb7405c01836151306ae: 2023-07-13 07:16:09,517 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1689232569078.6036d7d0cdc0eb7405c01836151306ae., pid=30, masterSystemTime=1689232569495 2023-07-13 07:16:09,519 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 0b04412d88ddbb268620c7618999ffba 2023-07-13 07:16:09,519 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1689232569078.6036d7d0cdc0eb7405c01836151306ae. 2023-07-13 07:16:09,519 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1689232569078.6036d7d0cdc0eb7405c01836151306ae. 2023-07-13 07:16:09,520 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=6036d7d0cdc0eb7405c01836151306ae, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:16:09,521 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1689232569078.6036d7d0cdc0eb7405c01836151306ae.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689232569520"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689232569520"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689232569520"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689232569520"}]},"ts":"1689232569520"} 2023-07-13 07:16:09,526 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=29 2023-07-13 07:16:09,526 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=29, state=SUCCESS; OpenRegionProcedure 6036d7d0cdc0eb7405c01836151306ae, server=jenkins-hbase20.apache.org,44195,1689232541463 in 182 msec 2023-07-13 07:16:09,527 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testExportFileSystemState/0b04412d88ddbb268620c7618999ffba/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-13 07:16:09,529 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6036d7d0cdc0eb7405c01836151306ae, ASSIGN in 348 msec 2023-07-13 07:16:09,529 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 0b04412d88ddbb268620c7618999ffba; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70193198, jitterRate=0.04596015810966492}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-13 07:16:09,530 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 0b04412d88ddbb268620c7618999ffba: 2023-07-13 07:16:09,530 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1689232569078.0b04412d88ddbb268620c7618999ffba., pid=31, masterSystemTime=1689232569500 2023-07-13 07:16:09,533 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1689232569078.0b04412d88ddbb268620c7618999ffba. 2023-07-13 07:16:09,533 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1689232569078.0b04412d88ddbb268620c7618999ffba. 2023-07-13 07:16:09,534 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=0b04412d88ddbb268620c7618999ffba, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:16:09,534 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1689232569078.0b04412d88ddbb268620c7618999ffba.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689232569534"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689232569534"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689232569534"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689232569534"}]},"ts":"1689232569534"} 2023-07-13 07:16:09,539 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=28 2023-07-13 07:16:09,539 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=28, state=SUCCESS; OpenRegionProcedure 0b04412d88ddbb268620c7618999ffba, server=jenkins-hbase20.apache.org,42807,1689232541407 in 193 msec 2023-07-13 07:16:09,542 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=27 2023-07-13 07:16:09,546 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=0b04412d88ddbb268620c7618999ffba, ASSIGN in 361 msec 2023-07-13 07:16:09,548 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-13 07:16:09,548 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689232569548"}]},"ts":"1689232569548"} 2023-07-13 07:16:09,550 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-07-13 07:16:09,554 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-13 07:16:09,554 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-07-13 07:16:09,560 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44607] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-13 07:16:09,569 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 07:16:09,569 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 07:16:09,569 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 07:16:09,569 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 07:16:09,573 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-13 07:16:09,573 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-13 07:16:09,573 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-13 07:16:09,573 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-13 07:16:09,575 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 493 msec 2023-07-13 07:16:09,692 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-13 07:16:09,692 INFO [Listener at jenkins-hbase20.apache.org/34497] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-07-13 07:16:09,692 DEBUG [Listener at jenkins-hbase20.apache.org/34497] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemState get assigned. Timeout = 60000ms 2023-07-13 07:16:09,692 INFO [Listener at jenkins-hbase20.apache.org/34497] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-13 07:16:09,696 INFO [Listener at jenkins-hbase20.apache.org/34497] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemState assigned to meta. Checking AM states. 2023-07-13 07:16:09,696 INFO [Listener at jenkins-hbase20.apache.org/34497] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-13 07:16:09,696 INFO [Listener at jenkins-hbase20.apache.org/34497] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemState assigned. 2023-07-13 07:16:09,700 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-13 07:16:09,700 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689232569700 (current time:1689232569700). 2023-07-13 07:16:09,700 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-13 07:16:09,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] zookeeper.ReadOnlyZKClient(139): Connect 0x63cf6679 to 127.0.0.1:58099 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-13 07:16:09,707 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@622d40c1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-13 07:16:09,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 07:16:09,710 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:48654, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 07:16:09,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x63cf6679 to 127.0.0.1:58099 2023-07-13 07:16:09,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 07:16:09,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] zookeeper.ReadOnlyZKClient(139): Connect 0x6c0cd235 to 127.0.0.1:58099 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-13 07:16:09,719 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@74e89d63, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-13 07:16:09,721 DEBUG [hconnection-0x7ccbe077-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 07:16:09,724 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:48670, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 07:16:09,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 07:16:09,734 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:52366, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 07:16:09,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6c0cd235 to 127.0.0.1:58099 2023-07-13 07:16:09,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 07:16:09,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-13 07:16:09,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-13 07:16:09,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-13 07:16:09,741 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-13 07:16:09,743 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-13 07:16:09,744 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689233169744 2023-07-13 07:16:09,744 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-13 07:16:09,744 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-13 07:16:09,746 DEBUG [Listener at jenkins-hbase20.apache.org/34497] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-13 07:16:09,746 DEBUG [Listener at jenkins-hbase20.apache.org/34497] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-13 07:16:09,748 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-13 07:16:09,748 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-13 07:16:09,749 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 8 msec 2023-07-13 07:16:09,751 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-13 07:16:09,752 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689233169752 2023-07-13 07:16:09,764 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-07-13 07:16:09,764 INFO [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-07-13 07:16:09,764 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 07:16:09,765 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-07-13 07:16:09,765 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-13 07:16:09,766 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-13 07:16:09,766 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-13 07:16:09,767 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:16:09,767 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:16:09,767 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:16:09,767 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:16:09,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:16:09,767 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:16:09,767 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:16:09,767 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:16:09,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:16:09,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:16:09,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-13 07:16:09,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-13 07:16:09,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-13 07:16:09,768 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:16:09,768 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-13 07:16:09,768 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:16:09,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-13 07:16:09,768 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:16:09,768 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-13 07:16:09,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-13 07:16:09,768 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-13 07:16:09,768 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-13 07:16:09,768 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-13 07:16:09,768 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-13 07:16:09,768 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-13 07:16:09,768 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 07:16:09,770 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-13 07:16:09,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-13 07:16:09,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-13 07:16:09,770 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-13 07:16:09,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-13 07:16:09,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-13 07:16:09,770 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44195,1689232541463' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-13 07:16:09,770 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-13 07:16:09,770 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-13 07:16:09,770 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-13 07:16:09,770 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-13 07:16:09,770 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-13 07:16:09,770 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-13 07:16:09,770 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 07:16:09,770 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 07:16:09,772 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-13 07:16:09,773 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-13 07:16:09,773 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,42807,1689232541407' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-13 07:16:09,773 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-13 07:16:09,773 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:16:09,773 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-13 07:16:09,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:16:09,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 07:16:09,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 07:16:09,773 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-13 07:16:09,773 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44607,1689232541504' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-13 07:16:09,773 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-13 07:16:09,773 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 07:16:09,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 07:16:09,776 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:16:09,776 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-13 07:16:09,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 07:16:09,776 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-13 07:16:09,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-13 07:16:09,776 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-13 07:16:09,777 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 07:16:09,777 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-13 07:16:09,777 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 07:16:09,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:16:09,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:16:09,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:16:09,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 07:16:09,778 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44195,1689232541463' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-13 07:16:09,778 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@81e5c4e[Count = 1] remaining members to acquire global barrier 2023-07-13 07:16:09,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:16:09,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 07:16:09,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 07:16:09,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 07:16:09,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 07:16:09,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-13 07:16:09,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:16:09,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:16:09,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:16:09,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 07:16:09,780 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,42807,1689232541407' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-13 07:16:09,780 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@81e5c4e[Count = 0] remaining members to acquire global barrier 2023-07-13 07:16:09,780 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-13 07:16:09,780 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-13 07:16:09,781 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-13 07:16:09,781 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-13 07:16:09,781 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-13 07:16:09,781 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-13 07:16:09,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-13 07:16:09,781 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-13 07:16:09,781 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-13 07:16:09,781 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:16:09,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-13 07:16:09,781 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-13 07:16:09,781 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-13 07:16:09,781 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase20.apache.org,44607,1689232541504' in zk 2023-07-13 07:16:09,781 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-13 07:16:09,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-13 07:16:09,782 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-13 07:16:09,782 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-13 07:16:09,782 DEBUG [rs(jenkins-hbase20.apache.org,44195,1689232541463)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689232569078.6036d7d0cdc0eb7405c01836151306ae. 2023-07-13 07:16:09,782 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-13 07:16:09,782 DEBUG [rs(jenkins-hbase20.apache.org,44195,1689232541463)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689232569078.6036d7d0cdc0eb7405c01836151306ae. started... 2023-07-13 07:16:09,782 DEBUG [rs(jenkins-hbase20.apache.org,42807,1689232541407)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689232569078.0b04412d88ddbb268620c7618999ffba. 2023-07-13 07:16:09,782 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-13 07:16:09,782 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-13 07:16:09,785 DEBUG [rs(jenkins-hbase20.apache.org,44195,1689232541463)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6036d7d0cdc0eb7405c01836151306ae: 2023-07-13 07:16:09,782 DEBUG [rs(jenkins-hbase20.apache.org,42807,1689232541407)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689232569078.0b04412d88ddbb268620c7618999ffba. started... 2023-07-13 07:16:09,782 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:16:09,786 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-13 07:16:09,786 DEBUG [rs(jenkins-hbase20.apache.org,44195,1689232541463)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689232569078.6036d7d0cdc0eb7405c01836151306ae.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-13 07:16:09,788 DEBUG [rs(jenkins-hbase20.apache.org,44195,1689232541463)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-13 07:16:09,788 DEBUG [rs(jenkins-hbase20.apache.org,42807,1689232541407)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0b04412d88ddbb268620c7618999ffba: 2023-07-13 07:16:09,788 DEBUG [rs(jenkins-hbase20.apache.org,44195,1689232541463)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-13 07:16:09,788 DEBUG [rs(jenkins-hbase20.apache.org,42807,1689232541407)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689232569078.0b04412d88ddbb268620c7618999ffba.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-13 07:16:09,788 DEBUG [rs(jenkins-hbase20.apache.org,42807,1689232541407)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-13 07:16:09,788 DEBUG [rs(jenkins-hbase20.apache.org,42807,1689232541407)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-13 07:16:09,788 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-13 07:16:09,788 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 07:16:09,788 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-13 07:16:09,822 DEBUG [rs(jenkins-hbase20.apache.org,44195,1689232541463)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689232569078.6036d7d0cdc0eb7405c01836151306ae. completed. 2023-07-13 07:16:09,823 DEBUG [rs(jenkins-hbase20.apache.org,44195,1689232541463)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689232569078.6036d7d0cdc0eb7405c01836151306ae. 2023-07-13 07:16:09,823 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-13 07:16:09,823 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-13 07:16:09,823 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:16:09,823 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-13 07:16:09,823 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase20.apache.org,44195,1689232541463' in zk 2023-07-13 07:16:09,824 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:16:09,824 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-13 07:16:09,824 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 07:16:09,824 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-13 07:16:09,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:16:09,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 07:16:09,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 07:16:09,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 07:16:09,826 DEBUG [rs(jenkins-hbase20.apache.org,42807,1689232541407)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689232569078.0b04412d88ddbb268620c7618999ffba. completed. 2023-07-13 07:16:09,826 DEBUG [rs(jenkins-hbase20.apache.org,42807,1689232541407)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689232569078.0b04412d88ddbb268620c7618999ffba. 2023-07-13 07:16:09,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 07:16:09,827 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-13 07:16:09,827 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-13 07:16:09,827 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:16:09,827 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-13 07:16:09,827 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase20.apache.org,42807,1689232541407' in zk 2023-07-13 07:16:09,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-13 07:16:09,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:16:09,828 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:16:09,828 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-13 07:16:09,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:16:09,828 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 07:16:09,828 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-13 07:16:09,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:16:09,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 07:16:09,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-13 07:16:09,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:16:09,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:16:09,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:16:09,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase20.apache.org,44195,1689232541463': 2023-07-13 07:16:09,832 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44195,1689232541463' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-13 07:16:09,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:16:09,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 07:16:09,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 07:16:09,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 07:16:09,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 07:16:09,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-13 07:16:09,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:16:09,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:16:09,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:16:09,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 07:16:09,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-13 07:16:09,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:16:09,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:16:09,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:16:09,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase20.apache.org,42807,1689232541407': 2023-07-13 07:16:09,834 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,42807,1689232541407' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-13 07:16:09,834 INFO [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-07-13 07:16:09,834 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-13 07:16:09,834 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-13 07:16:09,834 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-07-13 07:16:09,834 INFO [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-13 07:16:09,839 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-13 07:16:09,839 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-13 07:16:09,839 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-13 07:16:09,839 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-13 07:16:09,839 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-13 07:16:09,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-13 07:16:09,839 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-13 07:16:09,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-13 07:16:09,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-13 07:16:09,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 07:16:09,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 07:16:09,839 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:16:09,839 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:16:09,839 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-13 07:16:09,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-13 07:16:09,839 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:16:09,840 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:16:09,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 07:16:09,840 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:16:09,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:16:09,841 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:16:09,841 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:16:09,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:16:09,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:16:09,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-13 07:16:09,841 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:16:09,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-13 07:16:09,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-13 07:16:09,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-13 07:16:09,841 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:16:09,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 07:16:09,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-13 07:16:09,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:16:09,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:16:09,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:16:09,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 07:16:09,843 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:16:09,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-13 07:16:09,843 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:16:09,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:16:09,843 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:16:09,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:16:09,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:16:09,846 DEBUG [Listener at jenkins-hbase20.apache.org/34497] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 07:16:09,847 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-13 07:16:09,847 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-13 07:16:09,847 DEBUG [Listener at jenkins-hbase20.apache.org/34497] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-13 07:16:09,847 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:16:09,848 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:16:09,848 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:16:09,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:16:09,848 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:16:09,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:16:09,848 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:16:09,848 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 07:16:09,848 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:16:09,848 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-07-13 07:16:09,848 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:16:09,848 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:16:09,848 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:16:09,848 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:16:09,849 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:16:09,849 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:16:09,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:16:09,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:16:09,849 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-07-13 07:16:09,849 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-13 07:16:09,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:16:09,850 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:16:09,850 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:16:09,850 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-13 07:16:09,850 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:16:09,850 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-13 07:16:09,850 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:16:09,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:16:09,850 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:16:09,850 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:16:09,850 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-13 07:16:09,850 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-13 07:16:09,850 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-13 07:16:09,874 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-07-13 07:16:09,894 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-13 07:16:09,895 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-13 07:16:09,895 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-13 07:16:09,895 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689232569744Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1689232569849 (+105 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1689232569850 (+1 ms)Writing data manifest for emptySnaptb0-testExportFileSystemState at 1689232569853 (+3 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1689232569867 (+14 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689232569894 (+27 ms) 2023-07-13 07:16:09,897 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-13 07:16:09,900 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 152 msec 2023-07-13 07:16:10,048 DEBUG [Listener at jenkins-hbase20.apache.org/34497] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 07:16:10,049 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-13 07:16:10,049 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-13 07:16:10,072 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42807] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1689232569078.0b04412d88ddbb268620c7618999ffba. with WAL disabled. Data may be lost in the event of a crash. 2023-07-13 07:16:10,077 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44195] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1689232569078.6036d7d0cdc0eb7405c01836151306ae. with WAL disabled. Data may be lost in the event of a crash. 2023-07-13 07:16:10,089 DEBUG [Listener at jenkins-hbase20.apache.org/34497] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-13 07:16:10,090 DEBUG [Listener at jenkins-hbase20.apache.org/34497] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1689232569078.0b04412d88ddbb268620c7618999ffba. 2023-07-13 07:16:10,090 INFO [Listener at jenkins-hbase20.apache.org/34497] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-13 07:16:10,114 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-13 07:16:10,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689232570114 (current time:1689232570114). 2023-07-13 07:16:10,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-13 07:16:10,115 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] zookeeper.ReadOnlyZKClient(139): Connect 0x44f737df to 127.0.0.1:58099 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-13 07:16:10,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5f8b5332, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-13 07:16:10,127 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 07:16:10,131 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:48682, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 07:16:10,133 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x44f737df to 127.0.0.1:58099 2023-07-13 07:16:10,133 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 07:16:10,133 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] zookeeper.ReadOnlyZKClient(139): Connect 0x73f49172 to 127.0.0.1:58099 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-13 07:16:10,141 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@bd7c935, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-13 07:16:10,243 DEBUG [hconnection-0x6dc4e5e3-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 07:16:10,244 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:48698, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 07:16:10,251 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 07:16:10,252 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:52372, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 07:16:10,254 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x73f49172 to 127.0.0.1:58099 2023-07-13 07:16:10,254 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 07:16:10,254 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-13 07:16:10,255 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-13 07:16:10,255 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-13 07:16:10,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-13 07:16:10,260 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-13 07:16:10,260 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689233170260 2023-07-13 07:16:10,260 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-13 07:16:10,260 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-13 07:16:10,262 DEBUG [Listener at jenkins-hbase20.apache.org/34497] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-13 07:16:10,262 DEBUG [Listener at jenkins-hbase20.apache.org/34497] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-13 07:16:10,264 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-13 07:16:10,264 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-13 07:16:10,267 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 7 msec 2023-07-13 07:16:10,268 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-13 07:16:10,269 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689233170269 2023-07-13 07:16:10,282 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-07-13 07:16:10,282 INFO [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-07-13 07:16:10,282 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 07:16:10,284 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-07-13 07:16:10,284 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-13 07:16:10,284 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-13 07:16:10,284 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-13 07:16:10,285 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:16:10,285 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:16:10,285 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:16:10,285 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:16:10,285 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:16:10,285 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:16:10,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:16:10,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:16:10,285 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:16:10,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:16:10,285 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:16:10,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-13 07:16:10,285 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:16:10,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-13 07:16:10,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-13 07:16:10,286 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-13 07:16:10,286 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:16:10,286 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-13 07:16:10,286 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-13 07:16:10,286 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-13 07:16:10,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-13 07:16:10,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-13 07:16:10,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-13 07:16:10,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-13 07:16:10,286 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-13 07:16:10,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-13 07:16:10,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-13 07:16:10,286 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-13 07:16:10,286 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-13 07:16:10,286 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-13 07:16:10,286 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-13 07:16:10,286 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 07:16:10,288 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-13 07:16:10,288 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-13 07:16:10,288 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-13 07:16:10,288 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,42807,1689232541407' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-13 07:16:10,288 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-13 07:16:10,288 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 07:16:10,288 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-13 07:16:10,289 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-13 07:16:10,289 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-13 07:16:10,289 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 07:16:10,289 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-13 07:16:10,290 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-13 07:16:10,290 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44195,1689232541463' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-13 07:16:10,290 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-13 07:16:10,290 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44607,1689232541504' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-13 07:16:10,291 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-13 07:16:10,291 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:16:10,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:16:10,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 07:16:10,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 07:16:10,291 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:16:10,291 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-13 07:16:10,292 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-13 07:16:10,292 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-13 07:16:10,292 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 07:16:10,292 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-13 07:16:10,292 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 07:16:10,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 07:16:10,292 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-13 07:16:10,292 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 07:16:10,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 07:16:10,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-13 07:16:10,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:16:10,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:16:10,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:16:10,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 07:16:10,293 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,42807,1689232541407' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-13 07:16:10,293 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3b5962cf[Count = 1] remaining members to acquire global barrier 2023-07-13 07:16:10,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:16:10,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 07:16:10,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 07:16:10,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 07:16:10,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 07:16:10,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-13 07:16:10,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:16:10,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:16:10,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:16:10,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 07:16:10,295 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44195,1689232541463' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-13 07:16:10,295 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3b5962cf[Count = 0] remaining members to acquire global barrier 2023-07-13 07:16:10,295 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-13 07:16:10,295 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-13 07:16:10,295 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-13 07:16:10,295 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-13 07:16:10,295 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-13 07:16:10,295 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-13 07:16:10,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-13 07:16:10,295 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-13 07:16:10,295 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:16:10,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-13 07:16:10,295 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-13 07:16:10,295 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-13 07:16:10,296 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-13 07:16:10,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-13 07:16:10,296 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-13 07:16:10,296 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-13 07:16:10,296 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-13 07:16:10,296 DEBUG [rs(jenkins-hbase20.apache.org,44195,1689232541463)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689232569078.6036d7d0cdc0eb7405c01836151306ae. 2023-07-13 07:16:10,296 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-13 07:16:10,296 DEBUG [rs(jenkins-hbase20.apache.org,44195,1689232541463)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689232569078.6036d7d0cdc0eb7405c01836151306ae. started... 2023-07-13 07:16:10,296 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:16:10,296 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase20.apache.org,44607,1689232541504' in zk 2023-07-13 07:16:10,296 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-13 07:16:10,296 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-13 07:16:10,296 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-13 07:16:10,296 INFO [rs(jenkins-hbase20.apache.org,44195,1689232541463)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 6036d7d0cdc0eb7405c01836151306ae 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-13 07:16:10,296 DEBUG [rs(jenkins-hbase20.apache.org,42807,1689232541407)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689232569078.0b04412d88ddbb268620c7618999ffba. 2023-07-13 07:16:10,296 DEBUG [rs(jenkins-hbase20.apache.org,42807,1689232541407)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689232569078.0b04412d88ddbb268620c7618999ffba. started... 2023-07-13 07:16:10,296 INFO [rs(jenkins-hbase20.apache.org,42807,1689232541407)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 0b04412d88ddbb268620c7618999ffba 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-13 07:16:10,297 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-13 07:16:10,297 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 07:16:10,297 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-13 07:16:10,314 INFO [rs(jenkins-hbase20.apache.org,42807,1689232541407)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=266 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testExportFileSystemState/0b04412d88ddbb268620c7618999ffba/.tmp/cf/8cdb9a2d36a1402e90b4b52c9cfda2fe 2023-07-13 07:16:10,315 INFO [rs(jenkins-hbase20.apache.org,44195,1689232541463)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.00 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testExportFileSystemState/6036d7d0cdc0eb7405c01836151306ae/.tmp/cf/cd10846e679c4b9b9833b8cb64469fc3 2023-07-13 07:16:10,326 DEBUG [rs(jenkins-hbase20.apache.org,44195,1689232541463)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testExportFileSystemState/6036d7d0cdc0eb7405c01836151306ae/.tmp/cf/cd10846e679c4b9b9833b8cb64469fc3 as hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testExportFileSystemState/6036d7d0cdc0eb7405c01836151306ae/cf/cd10846e679c4b9b9833b8cb64469fc3 2023-07-13 07:16:10,326 DEBUG [rs(jenkins-hbase20.apache.org,42807,1689232541407)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testExportFileSystemState/0b04412d88ddbb268620c7618999ffba/.tmp/cf/8cdb9a2d36a1402e90b4b52c9cfda2fe as hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testExportFileSystemState/0b04412d88ddbb268620c7618999ffba/cf/8cdb9a2d36a1402e90b4b52c9cfda2fe 2023-07-13 07:16:10,333 INFO [rs(jenkins-hbase20.apache.org,44195,1689232541463)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testExportFileSystemState/6036d7d0cdc0eb7405c01836151306ae/cf/cd10846e679c4b9b9833b8cb64469fc3, entries=46, sequenceid=6, filesize=7.9 K 2023-07-13 07:16:10,333 INFO [rs(jenkins-hbase20.apache.org,42807,1689232541407)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testExportFileSystemState/0b04412d88ddbb268620c7618999ffba/cf/8cdb9a2d36a1402e90b4b52c9cfda2fe, entries=4, sequenceid=6, filesize=5.1 K 2023-07-13 07:16:10,334 INFO [rs(jenkins-hbase20.apache.org,42807,1689232541407)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 0b04412d88ddbb268620c7618999ffba in 38ms, sequenceid=6, compaction requested=false 2023-07-13 07:16:10,334 INFO [rs(jenkins-hbase20.apache.org,44195,1689232541463)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 6036d7d0cdc0eb7405c01836151306ae in 38ms, sequenceid=6, compaction requested=false 2023-07-13 07:16:10,334 DEBUG [rs(jenkins-hbase20.apache.org,42807,1689232541407)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-07-13 07:16:10,334 DEBUG [rs(jenkins-hbase20.apache.org,44195,1689232541463)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-07-13 07:16:10,337 DEBUG [rs(jenkins-hbase20.apache.org,42807,1689232541407)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0b04412d88ddbb268620c7618999ffba: 2023-07-13 07:16:10,337 DEBUG [rs(jenkins-hbase20.apache.org,44195,1689232541463)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6036d7d0cdc0eb7405c01836151306ae: 2023-07-13 07:16:10,337 DEBUG [rs(jenkins-hbase20.apache.org,42807,1689232541407)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689232569078.0b04412d88ddbb268620c7618999ffba.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-13 07:16:10,337 DEBUG [rs(jenkins-hbase20.apache.org,42807,1689232541407)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-13 07:16:10,337 DEBUG [rs(jenkins-hbase20.apache.org,44195,1689232541463)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689232569078.6036d7d0cdc0eb7405c01836151306ae.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-13 07:16:10,337 DEBUG [rs(jenkins-hbase20.apache.org,42807,1689232541407)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testExportFileSystemState/0b04412d88ddbb268620c7618999ffba/cf/8cdb9a2d36a1402e90b4b52c9cfda2fe] hfiles 2023-07-13 07:16:10,337 DEBUG [rs(jenkins-hbase20.apache.org,44195,1689232541463)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-13 07:16:10,338 DEBUG [rs(jenkins-hbase20.apache.org,42807,1689232541407)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testExportFileSystemState/0b04412d88ddbb268620c7618999ffba/cf/8cdb9a2d36a1402e90b4b52c9cfda2fe for snapshot=snaptb0-testExportFileSystemState 2023-07-13 07:16:10,338 DEBUG [rs(jenkins-hbase20.apache.org,44195,1689232541463)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testExportFileSystemState/6036d7d0cdc0eb7405c01836151306ae/cf/cd10846e679c4b9b9833b8cb64469fc3] hfiles 2023-07-13 07:16:10,338 DEBUG [rs(jenkins-hbase20.apache.org,44195,1689232541463)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testExportFileSystemState/6036d7d0cdc0eb7405c01836151306ae/cf/cd10846e679c4b9b9833b8cb64469fc3 for snapshot=snaptb0-testExportFileSystemState 2023-07-13 07:16:10,354 DEBUG [rs(jenkins-hbase20.apache.org,42807,1689232541407)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689232569078.0b04412d88ddbb268620c7618999ffba. completed. 2023-07-13 07:16:10,355 DEBUG [rs(jenkins-hbase20.apache.org,42807,1689232541407)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689232569078.0b04412d88ddbb268620c7618999ffba. 2023-07-13 07:16:10,355 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-13 07:16:10,355 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-13 07:16:10,355 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:16:10,355 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-13 07:16:10,355 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase20.apache.org,42807,1689232541407' in zk 2023-07-13 07:16:10,359 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-13 07:16:10,359 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:16:10,359 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 07:16:10,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:16:10,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 07:16:10,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 07:16:10,359 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-13 07:16:10,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 07:16:10,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 07:16:10,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-13 07:16:10,362 DEBUG [rs(jenkins-hbase20.apache.org,44195,1689232541463)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689232569078.6036d7d0cdc0eb7405c01836151306ae. completed. 2023-07-13 07:16:10,362 DEBUG [rs(jenkins-hbase20.apache.org,44195,1689232541463)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689232569078.6036d7d0cdc0eb7405c01836151306ae. 2023-07-13 07:16:10,362 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-13 07:16:10,362 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-13 07:16:10,362 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:16:10,362 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-13 07:16:10,362 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase20.apache.org,44195,1689232541463' in zk 2023-07-13 07:16:10,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:16:10,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:16:10,362 DEBUG [Listener at jenkins-hbase20.apache.org/34497] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 07:16:10,363 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:16:10,363 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-13 07:16:10,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:16:10,363 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 07:16:10,363 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-13 07:16:10,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 07:16:10,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-13 07:16:10,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-13 07:16:10,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-13 07:16:10,365 DEBUG [Listener at jenkins-hbase20.apache.org/34497] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-13 07:16:10,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:16:10,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:16:10,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:16:10,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase20.apache.org,42807,1689232541407': 2023-07-13 07:16:10,366 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,42807,1689232541407' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-13 07:16:10,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:16:10,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 07:16:10,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 07:16:10,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 07:16:10,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 07:16:10,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-13 07:16:10,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:16:10,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:16:10,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:16:10,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 07:16:10,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-13 07:16:10,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:16:10,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:16:10,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:16:10,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase20.apache.org,44195,1689232541463': 2023-07-13 07:16:10,370 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44195,1689232541463' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-13 07:16:10,370 INFO [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-07-13 07:16:10,370 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-13 07:16:10,370 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-13 07:16:10,370 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-07-13 07:16:10,370 INFO [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-13 07:16:10,371 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-13 07:16:10,371 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-13 07:16:10,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-13 07:16:10,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 07:16:10,371 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-13 07:16:10,371 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-13 07:16:10,371 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-13 07:16:10,371 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:16:10,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 07:16:10,371 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-13 07:16:10,371 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:16:10,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-13 07:16:10,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-13 07:16:10,371 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-13 07:16:10,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-13 07:16:10,371 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:16:10,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 07:16:10,372 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:16:10,372 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:16:10,372 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:16:10,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:16:10,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:16:10,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-13 07:16:10,375 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:16:10,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-13 07:16:10,375 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:16:10,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-13 07:16:10,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:16:10,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 07:16:10,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-13 07:16:10,376 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:16:10,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-13 07:16:10,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:16:10,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:16:10,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:16:10,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 07:16:10,378 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:16:10,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-13 07:16:10,378 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:16:10,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:16:10,378 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:16:10,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:16:10,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:16:10,389 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:16:10,389 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:16:10,389 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:16:10,389 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:16:10,389 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:16:10,390 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-13 07:16:10,390 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:16:10,390 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:16:10,390 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:16:10,390 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:16:10,390 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 07:16:10,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:16:10,389 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:16:10,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:16:10,389 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:16:10,390 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-07-13 07:16:10,390 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:16:10,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:16:10,392 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-13 07:16:10,392 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:16:10,392 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:16:10,392 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:16:10,391 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-07-13 07:16:10,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:16:10,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:16:10,392 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-13 07:16:10,392 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:16:10,392 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:16:10,392 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-13 07:16:10,392 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-13 07:16:10,392 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:16:10,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:16:10,393 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-13 07:16:10,420 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-13 07:16:10,441 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-13 07:16:10,441 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-13 07:16:10,442 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-13 07:16:10,442 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689232570261Consolidate snapshot: snaptb0-testExportFileSystemState at 1689232570391 (+130 ms)Loading Region manifests for snaptb0-testExportFileSystemState at 1689232570392 (+1 ms)Writing data manifest for snaptb0-testExportFileSystemState at 1689232570396 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1689232570411 (+15 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689232570441 (+30 ms) 2023-07-13 07:16:10,445 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-13 07:16:10,447 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 183 msec 2023-07-13 07:16:10,565 DEBUG [Listener at jenkins-hbase20.apache.org/34497] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 07:16:10,567 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-13 07:16:10,567 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-13 07:16:10,567 INFO [Listener at jenkins-hbase20.apache.org/34497] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/export-test/export-1689232570567 2023-07-13 07:16:10,567 INFO [Listener at jenkins-hbase20.apache.org/34497] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost.localdomain:40681, tgtDir=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/export-test/export-1689232570567, rawTgtDir=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/export-test/export-1689232570567, srcFsUri=hdfs://localhost.localdomain:40681, srcDir=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e 2023-07-13 07:16:10,601 DEBUG [Listener at jenkins-hbase20.apache.org/34497] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost.localdomain:40681, inputRoot=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e 2023-07-13 07:16:10,601 DEBUG [Listener at jenkins-hbase20.apache.org/34497] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-943570835_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/export-test/export-1689232570567, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/export-test/export-1689232570567/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-13 07:16:10,601 INFO [Listener at jenkins-hbase20.apache.org/34497] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost.localdomain:40681, inputRoot=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e, snapshotDir=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-07-13 07:16:10,611 INFO [Listener at jenkins-hbase20.apache.org/34497] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/export-test/export-1689232570567/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-13 07:16:10,642 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-13 07:16:10,642 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-13 07:16:10,643 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-13 07:16:10,643 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-13 07:16:10,643 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-13 07:16:10,644 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-13 07:16:10,644 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-13 07:16:10,716 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a827846-4542-2630-0c34-c6bc20d13d68/hadoop-8404173223442805537.jar 2023-07-13 07:16:10,717 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-13 07:16:10,717 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-13 07:16:10,717 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-13 07:16:10,718 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-13 07:16:10,718 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-13 07:16:10,718 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-13 07:16:10,719 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-13 07:16:10,719 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-13 07:16:10,719 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-13 07:16:10,720 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-13 07:16:10,720 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-13 07:16:10,720 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-13 07:16:10,721 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-13 07:16:10,721 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-13 07:16:10,722 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-13 07:16:10,723 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-13 07:16:10,723 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-13 07:16:10,724 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-13 07:16:10,724 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-13 07:16:10,724 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-13 07:16:10,724 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-13 07:16:10,725 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-13 07:16:10,725 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-13 07:16:11,288 WARN [Listener at jenkins-hbase20.apache.org/34497] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-13 07:16:11,291 INFO [Listener at jenkins-hbase20.apache.org/34497] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-07-13 07:16:11,295 DEBUG [Listener at jenkins-hbase20.apache.org/34497] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-13 07:16:13,423 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-13 07:16:13,423 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-13 07:16:13,428 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689232548306_0001_000001 (auth:SIMPLE) 2023-07-13 07:16:13,817 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689232548306_0002_000001 (auth:SIMPLE) 2023-07-13 07:16:14,338 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-13 07:16:18,078 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689232548306_0002_000001 (auth:SIMPLE) 2023-07-13 07:16:20,370 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689232548306_0002_000001 (auth:SIMPLE) 2023-07-13 07:16:23,708 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689232548306_0002_000001 (auth:SIMPLE) 2023-07-13 07:16:25,537 INFO [Listener at jenkins-hbase20.apache.org/34497] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-13 07:16:25,538 INFO [Listener at jenkins-hbase20.apache.org/34497] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-13 07:16:25,545 INFO [Listener at jenkins-hbase20.apache.org/34497] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-07-13 07:16:25,545 INFO [Listener at jenkins-hbase20.apache.org/34497] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-13 07:16:25,546 INFO [Listener at jenkins-hbase20.apache.org/34497] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-13 07:16:25,546 DEBUG [Listener at jenkins-hbase20.apache.org/34497] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_139625932_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-13 07:16:25,546 DEBUG [Listener at jenkins-hbase20.apache.org/34497] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-13 07:16:25,546 DEBUG [Listener at jenkins-hbase20.apache.org/34497] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-13 07:16:25,546 DEBUG [Listener at jenkins-hbase20.apache.org/34497] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_139625932_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/export-test/export-1689232570567/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/export-test/export-1689232570567/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-13 07:16:25,547 DEBUG [Listener at jenkins-hbase20.apache.org/34497] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/export-test/export-1689232570567/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-13 07:16:25,547 DEBUG [Listener at jenkins-hbase20.apache.org/34497] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/export-test/export-1689232570567/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-13 07:16:25,555 INFO [Listener at jenkins-hbase20.apache.org/34497] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-07-13 07:16:25,555 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testtb-testExportFileSystemState 2023-07-13 07:16:25,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] procedure2.ProcedureExecutor(1029): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-07-13 07:16:25,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-13 07:16:25,561 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689232585561"}]},"ts":"1689232585561"} 2023-07-13 07:16:25,562 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-07-13 07:16:25,563 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-07-13 07:16:25,564 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=0b04412d88ddbb268620c7618999ffba, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6036d7d0cdc0eb7405c01836151306ae, UNASSIGN}] 2023-07-13 07:16:25,567 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=0b04412d88ddbb268620c7618999ffba, UNASSIGN 2023-07-13 07:16:25,567 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6036d7d0cdc0eb7405c01836151306ae, UNASSIGN 2023-07-13 07:16:25,568 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=0b04412d88ddbb268620c7618999ffba, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:16:25,568 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=6036d7d0cdc0eb7405c01836151306ae, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:16:25,568 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689232569078.0b04412d88ddbb268620c7618999ffba.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689232585568"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689232585568"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689232585568"}]},"ts":"1689232585568"} 2023-07-13 07:16:25,568 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689232569078.6036d7d0cdc0eb7405c01836151306ae.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689232585568"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689232585568"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689232585568"}]},"ts":"1689232585568"} 2023-07-13 07:16:25,570 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=39, ppid=37, state=RUNNABLE; CloseRegionProcedure 0b04412d88ddbb268620c7618999ffba, server=jenkins-hbase20.apache.org,42807,1689232541407}] 2023-07-13 07:16:25,571 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=38, state=RUNNABLE; CloseRegionProcedure 6036d7d0cdc0eb7405c01836151306ae, server=jenkins-hbase20.apache.org,44195,1689232541463}] 2023-07-13 07:16:25,661 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-13 07:16:25,723 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 0b04412d88ddbb268620c7618999ffba 2023-07-13 07:16:25,723 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 0b04412d88ddbb268620c7618999ffba, disabling compactions & flushes 2023-07-13 07:16:25,723 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689232569078.0b04412d88ddbb268620c7618999ffba. 2023-07-13 07:16:25,723 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689232569078.0b04412d88ddbb268620c7618999ffba. 2023-07-13 07:16:25,723 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689232569078.0b04412d88ddbb268620c7618999ffba. after waiting 0 ms 2023-07-13 07:16:25,723 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689232569078.0b04412d88ddbb268620c7618999ffba. 2023-07-13 07:16:25,724 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 6036d7d0cdc0eb7405c01836151306ae 2023-07-13 07:16:25,724 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 6036d7d0cdc0eb7405c01836151306ae, disabling compactions & flushes 2023-07-13 07:16:25,725 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689232569078.6036d7d0cdc0eb7405c01836151306ae. 2023-07-13 07:16:25,728 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689232569078.6036d7d0cdc0eb7405c01836151306ae. 2023-07-13 07:16:25,728 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689232569078.6036d7d0cdc0eb7405c01836151306ae. after waiting 0 ms 2023-07-13 07:16:25,728 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689232569078.6036d7d0cdc0eb7405c01836151306ae. 2023-07-13 07:16:25,744 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testExportFileSystemState/0b04412d88ddbb268620c7618999ffba/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-13 07:16:25,745 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-13 07:16:25,747 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689232569078.0b04412d88ddbb268620c7618999ffba. 2023-07-13 07:16:25,747 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 0b04412d88ddbb268620c7618999ffba: 2023-07-13 07:16:25,747 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testExportFileSystemState/6036d7d0cdc0eb7405c01836151306ae/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-13 07:16:25,748 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 0b04412d88ddbb268620c7618999ffba 2023-07-13 07:16:25,749 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=0b04412d88ddbb268620c7618999ffba, regionState=CLOSED 2023-07-13 07:16:25,749 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689232569078.0b04412d88ddbb268620c7618999ffba.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689232585749"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689232585749"}]},"ts":"1689232585749"} 2023-07-13 07:16:25,750 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-13 07:16:25,752 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689232569078.6036d7d0cdc0eb7405c01836151306ae. 2023-07-13 07:16:25,752 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 6036d7d0cdc0eb7405c01836151306ae: 2023-07-13 07:16:25,755 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 6036d7d0cdc0eb7405c01836151306ae 2023-07-13 07:16:25,756 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=6036d7d0cdc0eb7405c01836151306ae, regionState=CLOSED 2023-07-13 07:16:25,756 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689232569078.6036d7d0cdc0eb7405c01836151306ae.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689232585756"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689232585756"}]},"ts":"1689232585756"} 2023-07-13 07:16:25,758 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=39, resume processing ppid=37 2023-07-13 07:16:25,759 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=37, state=SUCCESS; CloseRegionProcedure 0b04412d88ddbb268620c7618999ffba, server=jenkins-hbase20.apache.org,42807,1689232541407 in 186 msec 2023-07-13 07:16:25,766 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=0b04412d88ddbb268620c7618999ffba, UNASSIGN in 195 msec 2023-07-13 07:16:25,767 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=38 2023-07-13 07:16:25,767 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=38, state=SUCCESS; CloseRegionProcedure 6036d7d0cdc0eb7405c01836151306ae, server=jenkins-hbase20.apache.org,44195,1689232541463 in 187 msec 2023-07-13 07:16:25,772 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=38, resume processing ppid=36 2023-07-13 07:16:25,772 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6036d7d0cdc0eb7405c01836151306ae, UNASSIGN in 203 msec 2023-07-13 07:16:25,773 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689232585773"}]},"ts":"1689232585773"} 2023-07-13 07:16:25,775 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-07-13 07:16:25,776 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-07-13 07:16:25,779 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 222 msec 2023-07-13 07:16:25,863 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-13 07:16:25,863 INFO [Listener at jenkins-hbase20.apache.org/34497] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-07-13 07:16:25,864 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.HMaster$5(2228): Client=jenkins//148.251.75.209 delete testtb-testExportFileSystemState 2023-07-13 07:16:25,865 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] procedure2.ProcedureExecutor(1029): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-13 07:16:25,868 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-13 07:16:25,869 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-07-13 07:16:25,870 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-13 07:16:25,872 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44607] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-07-13 07:16:25,874 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-13 07:16:25,874 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-13 07:16:25,874 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-13 07:16:25,874 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-13 07:16:25,874 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-13 07:16:25,874 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-13 07:16:25,875 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-13 07:16:25,875 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-13 07:16:25,875 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-13 07:16:25,875 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-13 07:16:25,875 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 07:16:25,876 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 07:16:25,877 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-13 07:16:25,877 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 07:16:25,877 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-13 07:16:25,877 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 07:16:25,877 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testExportFileSystemState/0b04412d88ddbb268620c7618999ffba 2023-07-13 07:16:25,877 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testExportFileSystemState/6036d7d0cdc0eb7405c01836151306ae 2023-07-13 07:16:25,879 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-13 07:16:25,880 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testExportFileSystemState/0b04412d88ddbb268620c7618999ffba/cf, FileablePath, hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testExportFileSystemState/0b04412d88ddbb268620c7618999ffba/recovered.edits] 2023-07-13 07:16:25,881 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testExportFileSystemState/6036d7d0cdc0eb7405c01836151306ae/cf, FileablePath, hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testExportFileSystemState/6036d7d0cdc0eb7405c01836151306ae/recovered.edits] 2023-07-13 07:16:25,890 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testExportFileSystemState/6036d7d0cdc0eb7405c01836151306ae/cf/cd10846e679c4b9b9833b8cb64469fc3 to hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/archive/data/default/testtb-testExportFileSystemState/6036d7d0cdc0eb7405c01836151306ae/cf/cd10846e679c4b9b9833b8cb64469fc3 2023-07-13 07:16:25,890 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testExportFileSystemState/0b04412d88ddbb268620c7618999ffba/cf/8cdb9a2d36a1402e90b4b52c9cfda2fe to hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/archive/data/default/testtb-testExportFileSystemState/0b04412d88ddbb268620c7618999ffba/cf/8cdb9a2d36a1402e90b4b52c9cfda2fe 2023-07-13 07:16:25,894 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testExportFileSystemState/6036d7d0cdc0eb7405c01836151306ae/recovered.edits/9.seqid to hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/archive/data/default/testtb-testExportFileSystemState/6036d7d0cdc0eb7405c01836151306ae/recovered.edits/9.seqid 2023-07-13 07:16:25,894 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testExportFileSystemState/0b04412d88ddbb268620c7618999ffba/recovered.edits/9.seqid to hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/archive/data/default/testtb-testExportFileSystemState/0b04412d88ddbb268620c7618999ffba/recovered.edits/9.seqid 2023-07-13 07:16:25,895 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testExportFileSystemState/6036d7d0cdc0eb7405c01836151306ae 2023-07-13 07:16:25,895 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testExportFileSystemState/0b04412d88ddbb268620c7618999ffba 2023-07-13 07:16:25,895 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-13 07:16:25,898 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-13 07:16:25,902 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-07-13 07:16:25,905 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-07-13 07:16:25,908 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-13 07:16:25,908 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-07-13 07:16:25,908 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1689232569078.0b04412d88ddbb268620c7618999ffba.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689232585908"}]},"ts":"9223372036854775807"} 2023-07-13 07:16:25,908 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1689232569078.6036d7d0cdc0eb7405c01836151306ae.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689232585908"}]},"ts":"9223372036854775807"} 2023-07-13 07:16:25,913 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-13 07:16:25,913 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 0b04412d88ddbb268620c7618999ffba, NAME => 'testtb-testExportFileSystemState,,1689232569078.0b04412d88ddbb268620c7618999ffba.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 6036d7d0cdc0eb7405c01836151306ae, NAME => 'testtb-testExportFileSystemState,1,1689232569078.6036d7d0cdc0eb7405c01836151306ae.', STARTKEY => '1', ENDKEY => ''}] 2023-07-13 07:16:25,913 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-07-13 07:16:25,913 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689232585913"}]},"ts":"9223372036854775807"} 2023-07-13 07:16:25,916 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-07-13 07:16:25,919 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-13 07:16:25,921 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 55 msec 2023-07-13 07:16:25,980 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-13 07:16:25,981 INFO [Listener at jenkins-hbase20.apache.org/34497] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-07-13 07:16:25,993 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "emptySnaptb0-testExportFileSystemState" 2023-07-13 07:16:25,997 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-07-13 07:16:25,999 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "snaptb0-testExportFileSystemState" 2023-07-13 07:16:26,002 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-07-13 07:16:26,031 INFO [Listener at jenkins-hbase20.apache.org/34497] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemState Thread=762 (was 756) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_139625932_17 at /127.0.0.1:38920 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1950 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0xd7981d0-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0xd7981d0-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_339339818_1 at /127.0.0.1:38906 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (788891943) connection to jenkins-hbase20.apache.org/148.251.75.209:40215 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0xd7981d0-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_339339818_1 at /127.0.0.1:59938 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_139625932_17 at /127.0.0.1:57972 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0xd7981d0-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=931 (was 922) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=493 (was 454) - SystemLoadAverage LEAK? -, ProcessCount=169 (was 169), AvailableMemoryMB=3563 (was 3696) 2023-07-13 07:16:26,031 WARN [Listener at jenkins-hbase20.apache.org/34497] hbase.ResourceChecker(130): Thread=762 is superior to 500 2023-07-13 07:16:26,049 INFO [Listener at jenkins-hbase20.apache.org/34497] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testConsecutiveExports Thread=762, OpenFileDescriptor=931, MaxFileDescriptor=60000, SystemLoadAverage=493, ProcessCount=169, AvailableMemoryMB=3562 2023-07-13 07:16:26,049 WARN [Listener at jenkins-hbase20.apache.org/34497] hbase.ResourceChecker(130): Thread=762 is superior to 500 2023-07-13 07:16:26,051 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-13 07:16:26,052 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-07-13 07:16:26,054 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-07-13 07:16:26,054 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-07-13 07:16:26,055 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-13 07:16:26,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-13 07:16:26,057 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testConsecutiveExports/d987b037d0d2f4bd939e54b622437e4b 2023-07-13 07:16:26,057 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testConsecutiveExports/80d5300305ba23d4c38b75f529bdd008 2023-07-13 07:16:26,058 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testConsecutiveExports/d987b037d0d2f4bd939e54b622437e4b empty. 2023-07-13 07:16:26,058 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testConsecutiveExports/80d5300305ba23d4c38b75f529bdd008 empty. 2023-07-13 07:16:26,058 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testConsecutiveExports/d987b037d0d2f4bd939e54b622437e4b 2023-07-13 07:16:26,058 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testConsecutiveExports/80d5300305ba23d4c38b75f529bdd008 2023-07-13 07:16:26,058 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-13 07:16:26,072 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-07-13 07:16:26,074 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => d987b037d0d2f4bd939e54b622437e4b, NAME => 'testtb-testConsecutiveExports,,1689232586050.d987b037d0d2f4bd939e54b622437e4b.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp 2023-07-13 07:16:26,074 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => 80d5300305ba23d4c38b75f529bdd008, NAME => 'testtb-testConsecutiveExports,1,1689232586050.80d5300305ba23d4c38b75f529bdd008.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp 2023-07-13 07:16:26,148 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689232586050.80d5300305ba23d4c38b75f529bdd008.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 07:16:26,148 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing 80d5300305ba23d4c38b75f529bdd008, disabling compactions & flushes 2023-07-13 07:16:26,149 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689232586050.80d5300305ba23d4c38b75f529bdd008. 2023-07-13 07:16:26,149 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689232586050.80d5300305ba23d4c38b75f529bdd008. 2023-07-13 07:16:26,149 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689232586050.80d5300305ba23d4c38b75f529bdd008. after waiting 0 ms 2023-07-13 07:16:26,149 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689232586050.80d5300305ba23d4c38b75f529bdd008. 2023-07-13 07:16:26,149 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689232586050.80d5300305ba23d4c38b75f529bdd008. 2023-07-13 07:16:26,149 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for 80d5300305ba23d4c38b75f529bdd008: 2023-07-13 07:16:26,149 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689232586050.d987b037d0d2f4bd939e54b622437e4b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 07:16:26,149 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing d987b037d0d2f4bd939e54b622437e4b, disabling compactions & flushes 2023-07-13 07:16:26,149 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689232586050.d987b037d0d2f4bd939e54b622437e4b. 2023-07-13 07:16:26,149 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689232586050.d987b037d0d2f4bd939e54b622437e4b. 2023-07-13 07:16:26,149 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689232586050.d987b037d0d2f4bd939e54b622437e4b. after waiting 0 ms 2023-07-13 07:16:26,150 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689232586050.d987b037d0d2f4bd939e54b622437e4b. 2023-07-13 07:16:26,150 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689232586050.d987b037d0d2f4bd939e54b622437e4b. 2023-07-13 07:16:26,150 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for d987b037d0d2f4bd939e54b622437e4b: 2023-07-13 07:16:26,155 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-07-13 07:16:26,156 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689232586050.80d5300305ba23d4c38b75f529bdd008.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689232586156"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689232586156"}]},"ts":"1689232586156"} 2023-07-13 07:16:26,157 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689232586050.d987b037d0d2f4bd939e54b622437e4b.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689232586156"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689232586156"}]},"ts":"1689232586156"} 2023-07-13 07:16:26,160 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-13 07:16:26,169 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-13 07:16:26,171 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-13 07:16:26,171 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689232586171"}]},"ts":"1689232586171"} 2023-07-13 07:16:26,173 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-07-13 07:16:26,176 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-07-13 07:16:26,177 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-13 07:16:26,178 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-13 07:16:26,178 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-13 07:16:26,178 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-13 07:16:26,178 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=d987b037d0d2f4bd939e54b622437e4b, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=80d5300305ba23d4c38b75f529bdd008, ASSIGN}] 2023-07-13 07:16:26,181 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=d987b037d0d2f4bd939e54b622437e4b, ASSIGN 2023-07-13 07:16:26,181 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=80d5300305ba23d4c38b75f529bdd008, ASSIGN 2023-07-13 07:16:26,183 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=d987b037d0d2f4bd939e54b622437e4b, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,44607,1689232541504; forceNewPlan=false, retain=false 2023-07-13 07:16:26,183 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=80d5300305ba23d4c38b75f529bdd008, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,44195,1689232541463; forceNewPlan=false, retain=false 2023-07-13 07:16:26,333 INFO [jenkins-hbase20:37475] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-13 07:16:26,336 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=80d5300305ba23d4c38b75f529bdd008, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:16:26,336 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=d987b037d0d2f4bd939e54b622437e4b, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:16:26,337 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689232586050.80d5300305ba23d4c38b75f529bdd008.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689232586336"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689232586336"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689232586336"}]},"ts":"1689232586336"} 2023-07-13 07:16:26,337 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689232586050.d987b037d0d2f4bd939e54b622437e4b.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689232586336"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689232586336"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689232586336"}]},"ts":"1689232586336"} 2023-07-13 07:16:26,339 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE; OpenRegionProcedure 80d5300305ba23d4c38b75f529bdd008, server=jenkins-hbase20.apache.org,44195,1689232541463}] 2023-07-13 07:16:26,340 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=43, state=RUNNABLE; OpenRegionProcedure d987b037d0d2f4bd939e54b622437e4b, server=jenkins-hbase20.apache.org,44607,1689232541504}] 2023-07-13 07:16:26,361 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-13 07:16:26,502 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1689232586050.80d5300305ba23d4c38b75f529bdd008. 2023-07-13 07:16:26,503 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 80d5300305ba23d4c38b75f529bdd008, NAME => 'testtb-testConsecutiveExports,1,1689232586050.80d5300305ba23d4c38b75f529bdd008.', STARTKEY => '1', ENDKEY => ''} 2023-07-13 07:16:26,503 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1689232586050.d987b037d0d2f4bd939e54b622437e4b. 2023-07-13 07:16:26,503 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1689232586050.80d5300305ba23d4c38b75f529bdd008. service=AccessControlService 2023-07-13 07:16:26,503 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d987b037d0d2f4bd939e54b622437e4b, NAME => 'testtb-testConsecutiveExports,,1689232586050.d987b037d0d2f4bd939e54b622437e4b.', STARTKEY => '', ENDKEY => '1'} 2023-07-13 07:16:26,503 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-13 07:16:26,504 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1689232586050.d987b037d0d2f4bd939e54b622437e4b. service=AccessControlService 2023-07-13 07:16:26,504 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 80d5300305ba23d4c38b75f529bdd008 2023-07-13 07:16:26,504 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689232586050.80d5300305ba23d4c38b75f529bdd008.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 07:16:26,504 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-13 07:16:26,504 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 80d5300305ba23d4c38b75f529bdd008 2023-07-13 07:16:26,504 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 80d5300305ba23d4c38b75f529bdd008 2023-07-13 07:16:26,504 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports d987b037d0d2f4bd939e54b622437e4b 2023-07-13 07:16:26,504 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689232586050.d987b037d0d2f4bd939e54b622437e4b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 07:16:26,504 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for d987b037d0d2f4bd939e54b622437e4b 2023-07-13 07:16:26,504 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for d987b037d0d2f4bd939e54b622437e4b 2023-07-13 07:16:26,515 INFO [StoreOpener-80d5300305ba23d4c38b75f529bdd008-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 80d5300305ba23d4c38b75f529bdd008 2023-07-13 07:16:26,515 INFO [StoreOpener-d987b037d0d2f4bd939e54b622437e4b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region d987b037d0d2f4bd939e54b622437e4b 2023-07-13 07:16:26,518 DEBUG [StoreOpener-d987b037d0d2f4bd939e54b622437e4b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testConsecutiveExports/d987b037d0d2f4bd939e54b622437e4b/cf 2023-07-13 07:16:26,518 DEBUG [StoreOpener-d987b037d0d2f4bd939e54b622437e4b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testConsecutiveExports/d987b037d0d2f4bd939e54b622437e4b/cf 2023-07-13 07:16:26,518 DEBUG [StoreOpener-80d5300305ba23d4c38b75f529bdd008-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testConsecutiveExports/80d5300305ba23d4c38b75f529bdd008/cf 2023-07-13 07:16:26,518 DEBUG [StoreOpener-80d5300305ba23d4c38b75f529bdd008-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testConsecutiveExports/80d5300305ba23d4c38b75f529bdd008/cf 2023-07-13 07:16:26,518 INFO [StoreOpener-d987b037d0d2f4bd939e54b622437e4b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d987b037d0d2f4bd939e54b622437e4b columnFamilyName cf 2023-07-13 07:16:26,519 INFO [StoreOpener-80d5300305ba23d4c38b75f529bdd008-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 80d5300305ba23d4c38b75f529bdd008 columnFamilyName cf 2023-07-13 07:16:26,519 INFO [StoreOpener-d987b037d0d2f4bd939e54b622437e4b-1] regionserver.HStore(310): Store=d987b037d0d2f4bd939e54b622437e4b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-13 07:16:26,519 INFO [StoreOpener-80d5300305ba23d4c38b75f529bdd008-1] regionserver.HStore(310): Store=80d5300305ba23d4c38b75f529bdd008/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-13 07:16:26,520 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testConsecutiveExports/d987b037d0d2f4bd939e54b622437e4b 2023-07-13 07:16:26,520 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testConsecutiveExports/d987b037d0d2f4bd939e54b622437e4b 2023-07-13 07:16:26,520 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testConsecutiveExports/80d5300305ba23d4c38b75f529bdd008 2023-07-13 07:16:26,521 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testConsecutiveExports/80d5300305ba23d4c38b75f529bdd008 2023-07-13 07:16:26,522 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for d987b037d0d2f4bd939e54b622437e4b 2023-07-13 07:16:26,523 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 80d5300305ba23d4c38b75f529bdd008 2023-07-13 07:16:26,524 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testConsecutiveExports/d987b037d0d2f4bd939e54b622437e4b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-13 07:16:26,524 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testConsecutiveExports/80d5300305ba23d4c38b75f529bdd008/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-13 07:16:26,525 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 80d5300305ba23d4c38b75f529bdd008; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62550083, jitterRate=-0.06793113052845001}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-13 07:16:26,525 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened d987b037d0d2f4bd939e54b622437e4b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63978343, jitterRate=-0.04664839804172516}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-13 07:16:26,525 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 80d5300305ba23d4c38b75f529bdd008: 2023-07-13 07:16:26,525 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for d987b037d0d2f4bd939e54b622437e4b: 2023-07-13 07:16:26,526 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1689232586050.d987b037d0d2f4bd939e54b622437e4b., pid=46, masterSystemTime=1689232586493 2023-07-13 07:16:26,526 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1689232586050.80d5300305ba23d4c38b75f529bdd008., pid=45, masterSystemTime=1689232586492 2023-07-13 07:16:26,528 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1689232586050.d987b037d0d2f4bd939e54b622437e4b. 2023-07-13 07:16:26,528 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1689232586050.d987b037d0d2f4bd939e54b622437e4b. 2023-07-13 07:16:26,528 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=d987b037d0d2f4bd939e54b622437e4b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:16:26,529 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1689232586050.d987b037d0d2f4bd939e54b622437e4b.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689232586528"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689232586528"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689232586528"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689232586528"}]},"ts":"1689232586528"} 2023-07-13 07:16:26,529 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1689232586050.80d5300305ba23d4c38b75f529bdd008. 2023-07-13 07:16:26,529 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1689232586050.80d5300305ba23d4c38b75f529bdd008. 2023-07-13 07:16:26,529 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=80d5300305ba23d4c38b75f529bdd008, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:16:26,529 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1689232586050.80d5300305ba23d4c38b75f529bdd008.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689232586529"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689232586529"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689232586529"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689232586529"}]},"ts":"1689232586529"} 2023-07-13 07:16:26,534 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=43 2023-07-13 07:16:26,534 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=44 2023-07-13 07:16:26,534 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=43, state=SUCCESS; OpenRegionProcedure d987b037d0d2f4bd939e54b622437e4b, server=jenkins-hbase20.apache.org,44607,1689232541504 in 192 msec 2023-07-13 07:16:26,534 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=44, state=SUCCESS; OpenRegionProcedure 80d5300305ba23d4c38b75f529bdd008, server=jenkins-hbase20.apache.org,44195,1689232541463 in 193 msec 2023-07-13 07:16:26,536 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=d987b037d0d2f4bd939e54b622437e4b, ASSIGN in 356 msec 2023-07-13 07:16:26,536 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=42 2023-07-13 07:16:26,536 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=80d5300305ba23d4c38b75f529bdd008, ASSIGN in 356 msec 2023-07-13 07:16:26,537 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-13 07:16:26,537 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689232586537"}]},"ts":"1689232586537"} 2023-07-13 07:16:26,538 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-07-13 07:16:26,540 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-07-13 07:16:26,541 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-07-13 07:16:26,543 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44607] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-13 07:16:26,544 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 07:16:26,544 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 07:16:26,544 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 07:16:26,544 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 07:16:26,545 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-13 07:16:26,545 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-13 07:16:26,545 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-13 07:16:26,545 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-13 07:16:26,547 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 494 msec 2023-07-13 07:16:26,663 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-13 07:16:26,663 INFO [Listener at jenkins-hbase20.apache.org/34497] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-07-13 07:16:26,663 DEBUG [Listener at jenkins-hbase20.apache.org/34497] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testConsecutiveExports get assigned. Timeout = 60000ms 2023-07-13 07:16:26,663 INFO [Listener at jenkins-hbase20.apache.org/34497] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-13 07:16:26,667 INFO [Listener at jenkins-hbase20.apache.org/34497] hbase.HBaseTestingUtility(3484): All regions for table testtb-testConsecutiveExports assigned to meta. Checking AM states. 2023-07-13 07:16:26,668 INFO [Listener at jenkins-hbase20.apache.org/34497] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-13 07:16:26,668 INFO [Listener at jenkins-hbase20.apache.org/34497] hbase.HBaseTestingUtility(3504): All regions for table testtb-testConsecutiveExports assigned. 2023-07-13 07:16:26,671 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-13 07:16:26,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689232586671 (current time:1689232586671). 2023-07-13 07:16:26,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-13 07:16:26,672 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] zookeeper.ReadOnlyZKClient(139): Connect 0x6f82c46c to 127.0.0.1:58099 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-13 07:16:26,684 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4d79cdc5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-13 07:16:26,687 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 07:16:26,692 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:52922, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 07:16:26,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6f82c46c to 127.0.0.1:58099 2023-07-13 07:16:26,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 07:16:26,695 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] zookeeper.ReadOnlyZKClient(139): Connect 0x7c839b44 to 127.0.0.1:58099 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-13 07:16:26,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5db811c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-13 07:16:26,803 DEBUG [hconnection-0x6cf7387-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 07:16:26,808 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:52926, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 07:16:26,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 07:16:26,820 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:37448, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 07:16:26,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7c839b44 to 127.0.0.1:58099 2023-07-13 07:16:26,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 07:16:26,822 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-13 07:16:26,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-13 07:16:26,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-13 07:16:26,825 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] procedure2.ProcedureExecutor(1029): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-13 07:16:26,827 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-13 07:16:26,828 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689233186828 2023-07-13 07:16:26,828 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-13 07:16:26,828 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-13 07:16:26,831 DEBUG [Listener at jenkins-hbase20.apache.org/34497] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-13 07:16:26,831 DEBUG [Listener at jenkins-hbase20.apache.org/34497] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-13 07:16:26,831 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-13 07:16:26,834 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-13 07:16:26,842 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 10 msec 2023-07-13 07:16:26,844 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-13 07:16:26,846 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689233186846 2023-07-13 07:16:26,901 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-07-13 07:16:26,901 INFO [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-07-13 07:16:26,902 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 07:16:26,904 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-07-13 07:16:26,904 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-13 07:16:26,904 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-13 07:16:26,905 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-13 07:16:26,906 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:16:26,906 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:16:26,906 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:16:26,906 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:16:26,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:16:26,906 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:16:26,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:16:26,906 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:16:26,906 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:16:26,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:16:26,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-13 07:16:26,907 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:16:26,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-13 07:16:26,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-13 07:16:26,907 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:16:26,907 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-13 07:16:26,908 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-13 07:16:26,908 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:16:26,908 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-13 07:16:26,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-13 07:16:26,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-13 07:16:26,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-13 07:16:26,908 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-13 07:16:26,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-13 07:16:26,908 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-13 07:16:26,908 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-13 07:16:26,908 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-13 07:16:26,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-13 07:16:26,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-13 07:16:26,909 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-13 07:16:26,909 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-13 07:16:26,909 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 07:16:26,910 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-13 07:16:26,912 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-13 07:16:26,912 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-13 07:16:26,912 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-13 07:16:26,912 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 07:16:26,912 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-13 07:16:26,914 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-13 07:16:26,914 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-13 07:16:26,914 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-13 07:16:26,912 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 07:16:26,914 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,42807,1689232541407' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-13 07:16:26,914 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44195,1689232541463' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-13 07:16:26,920 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-13 07:16:26,921 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-13 07:16:26,921 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44607,1689232541504' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-13 07:16:26,922 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:16:26,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:16:26,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 07:16:26,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 07:16:26,922 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-13 07:16:26,922 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:16:26,923 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-13 07:16:26,923 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-13 07:16:26,923 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-13 07:16:26,923 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 07:16:26,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 07:16:26,923 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-13 07:16:26,923 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 07:16:26,923 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-13 07:16:26,923 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 07:16:26,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 07:16:26,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-13 07:16:26,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:16:26,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:16:26,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:16:26,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 07:16:26,927 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44195,1689232541463' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-13 07:16:26,927 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@30760aa[Count = 1] remaining members to acquire global barrier 2023-07-13 07:16:26,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:16:26,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 07:16:26,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 07:16:26,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 07:16:26,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 07:16:26,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-13 07:16:26,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:16:26,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:16:26,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:16:26,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 07:16:26,929 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44607,1689232541504' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-13 07:16:26,929 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@30760aa[Count = 0] remaining members to acquire global barrier 2023-07-13 07:16:26,929 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-13 07:16:26,929 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-13 07:16:26,931 DEBUG [Listener at jenkins-hbase20.apache.org/34497] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 07:16:26,931 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-13 07:16:26,931 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-13 07:16:26,931 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-13 07:16:26,932 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-13 07:16:26,932 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-13 07:16:26,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-13 07:16:26,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-13 07:16:26,932 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-13 07:16:26,932 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-13 07:16:26,932 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:16:26,932 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-13 07:16:26,932 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-13 07:16:26,932 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase20.apache.org,42807,1689232541407' in zk 2023-07-13 07:16:26,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-13 07:16:26,932 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-13 07:16:26,932 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-13 07:16:26,932 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-13 07:16:26,932 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-13 07:16:26,932 DEBUG [rs(jenkins-hbase20.apache.org,44607,1689232541504)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689232586050.d987b037d0d2f4bd939e54b622437e4b. 2023-07-13 07:16:26,932 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-13 07:16:26,932 DEBUG [Listener at jenkins-hbase20.apache.org/34497] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-13 07:16:26,933 DEBUG [rs(jenkins-hbase20.apache.org,44607,1689232541504)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689232586050.d987b037d0d2f4bd939e54b622437e4b. started... 2023-07-13 07:16:26,933 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:16:26,933 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-13 07:16:26,934 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-13 07:16:26,936 DEBUG [rs(jenkins-hbase20.apache.org,44607,1689232541504)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d987b037d0d2f4bd939e54b622437e4b: 2023-07-13 07:16:26,937 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-13 07:16:26,936 DEBUG [rs(jenkins-hbase20.apache.org,44195,1689232541463)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689232586050.80d5300305ba23d4c38b75f529bdd008. 2023-07-13 07:16:26,937 DEBUG [rs(jenkins-hbase20.apache.org,44195,1689232541463)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689232586050.80d5300305ba23d4c38b75f529bdd008. started... 2023-07-13 07:16:26,937 DEBUG [rs(jenkins-hbase20.apache.org,44607,1689232541504)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689232586050.d987b037d0d2f4bd939e54b622437e4b.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-13 07:16:26,939 DEBUG [rs(jenkins-hbase20.apache.org,44607,1689232541504)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-13 07:16:26,939 DEBUG [rs(jenkins-hbase20.apache.org,44607,1689232541504)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-13 07:16:26,943 DEBUG [rs(jenkins-hbase20.apache.org,44195,1689232541463)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 80d5300305ba23d4c38b75f529bdd008: 2023-07-13 07:16:26,944 DEBUG [rs(jenkins-hbase20.apache.org,44195,1689232541463)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689232586050.80d5300305ba23d4c38b75f529bdd008.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-13 07:16:26,944 DEBUG [rs(jenkins-hbase20.apache.org,44195,1689232541463)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-13 07:16:26,944 DEBUG [rs(jenkins-hbase20.apache.org,44195,1689232541463)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-13 07:16:26,956 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-13 07:16:26,956 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 07:16:26,956 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-13 07:16:26,998 DEBUG [rs(jenkins-hbase20.apache.org,44607,1689232541504)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689232586050.d987b037d0d2f4bd939e54b622437e4b. completed. 2023-07-13 07:16:26,998 DEBUG [rs(jenkins-hbase20.apache.org,44607,1689232541504)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689232586050.d987b037d0d2f4bd939e54b622437e4b. 2023-07-13 07:16:26,999 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-13 07:16:26,999 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-13 07:16:26,999 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:16:26,999 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-13 07:16:26,999 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase20.apache.org,44607,1689232541504' in zk 2023-07-13 07:16:27,006 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-13 07:16:27,006 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:16:27,006 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 07:16:27,006 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-13 07:16:27,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:16:27,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 07:16:27,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 07:16:27,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 07:16:27,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 07:16:27,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-13 07:16:27,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:16:27,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:16:27,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:16:27,012 DEBUG [rs(jenkins-hbase20.apache.org,44195,1689232541463)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689232586050.80d5300305ba23d4c38b75f529bdd008. completed. 2023-07-13 07:16:27,012 DEBUG [rs(jenkins-hbase20.apache.org,44195,1689232541463)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689232586050.80d5300305ba23d4c38b75f529bdd008. 2023-07-13 07:16:27,012 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-13 07:16:27,012 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-13 07:16:27,012 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:16:27,012 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-13 07:16:27,012 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase20.apache.org,44195,1689232541463' in zk 2023-07-13 07:16:27,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 07:16:27,022 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-13 07:16:27,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-13 07:16:27,022 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:16:27,022 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 07:16:27,022 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-13 07:16:27,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:16:27,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:16:27,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:16:27,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase20.apache.org,44607,1689232541504': 2023-07-13 07:16:27,025 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44607,1689232541504' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-13 07:16:27,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:16:27,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 07:16:27,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 07:16:27,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 07:16:27,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 07:16:27,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-13 07:16:27,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:16:27,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:16:27,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:16:27,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 07:16:27,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-13 07:16:27,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:16:27,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:16:27,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:16:27,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase20.apache.org,44195,1689232541463': 2023-07-13 07:16:27,029 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44195,1689232541463' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-13 07:16:27,029 INFO [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-07-13 07:16:27,029 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-13 07:16:27,029 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-13 07:16:27,029 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-07-13 07:16:27,029 INFO [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-13 07:16:27,045 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-13 07:16:27,045 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-13 07:16:27,046 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-13 07:16:27,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-13 07:16:27,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 07:16:27,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 07:16:27,045 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-13 07:16:27,046 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:16:27,046 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-13 07:16:27,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-13 07:16:27,046 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:16:27,046 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-13 07:16:27,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-13 07:16:27,045 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:16:27,046 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-13 07:16:27,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-13 07:16:27,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 07:16:27,046 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:16:27,046 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:16:27,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:16:27,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:16:27,047 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:16:27,047 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:16:27,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:16:27,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-13 07:16:27,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-13 07:16:27,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-13 07:16:27,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-13 07:16:27,047 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:16:27,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 07:16:27,048 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:16:27,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-13 07:16:27,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:16:27,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:16:27,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:16:27,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 07:16:27,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-13 07:16:27,051 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:16:27,051 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:16:27,051 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:16:27,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:16:27,054 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:16:27,054 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:16:27,054 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:16:27,054 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:16:27,054 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:16:27,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:16:27,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:16:27,054 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:16:27,054 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:16:27,054 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:16:27,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:16:27,054 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:16:27,054 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:16:27,055 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:16:27,055 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:16:27,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:16:27,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:16:27,055 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-13 07:16:27,055 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:16:27,055 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:16:27,055 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-13 07:16:27,055 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:16:27,055 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-13 07:16:27,055 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:16:27,055 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:16:27,055 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-13 07:16:27,055 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-13 07:16:27,055 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 07:16:27,055 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-07-13 07:16:27,057 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-07-13 07:16:27,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:16:27,058 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:16:27,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:16:27,059 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-13 07:16:27,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:16:27,061 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports because node does not exist (not an error) 2023-07-13 07:16:27,133 DEBUG [Listener at jenkins-hbase20.apache.org/34497] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 07:16:27,134 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-13 07:16:27,134 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-13 07:16:27,136 DEBUG [Listener at jenkins-hbase20.apache.org/34497] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-13 07:16:27,189 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-07-13 07:16:27,285 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-13 07:16:27,285 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-13 07:16:27,286 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-13 07:16:27,286 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689232586828Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1689232587057 (+229 ms)Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1689232587057Writing data manifest for emptySnaptb0-testConsecutiveExports at 1689232587074 (+17 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1689232587174 (+100 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689232587285 (+111 ms) 2023-07-13 07:16:27,295 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-13 07:16:27,302 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 465 msec 2023-07-13 07:16:27,436 DEBUG [Listener at jenkins-hbase20.apache.org/34497] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 07:16:27,437 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-13 07:16:27,437 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-13 07:16:27,446 DEBUG [htable-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 07:16:27,448 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44195] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1689232586050.80d5300305ba23d4c38b75f529bdd008. with WAL disabled. Data may be lost in the event of a crash. 2023-07-13 07:16:27,456 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:37462, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 07:16:27,457 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44607] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1689232586050.d987b037d0d2f4bd939e54b622437e4b. with WAL disabled. Data may be lost in the event of a crash. 2023-07-13 07:16:27,461 DEBUG [Listener at jenkins-hbase20.apache.org/34497] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-13 07:16:27,461 DEBUG [Listener at jenkins-hbase20.apache.org/34497] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1689232586050.d987b037d0d2f4bd939e54b622437e4b. 2023-07-13 07:16:27,462 INFO [Listener at jenkins-hbase20.apache.org/34497] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-13 07:16:27,479 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-13 07:16:27,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689232587479 (current time:1689232587479). 2023-07-13 07:16:27,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-13 07:16:27,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] zookeeper.ReadOnlyZKClient(139): Connect 0x6073f4fc to 127.0.0.1:58099 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-13 07:16:27,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@626103bb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-13 07:16:27,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 07:16:27,495 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:52930, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 07:16:27,497 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6073f4fc to 127.0.0.1:58099 2023-07-13 07:16:27,497 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 07:16:27,497 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] zookeeper.ReadOnlyZKClient(139): Connect 0x6f34649c to 127.0.0.1:58099 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-13 07:16:27,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@109fb992, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-13 07:16:27,516 DEBUG [hconnection-0x7a090ce1-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 07:16:27,520 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:52942, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 07:16:27,526 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 07:16:27,528 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:37470, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 07:16:27,529 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6f34649c to 127.0.0.1:58099 2023-07-13 07:16:27,529 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 07:16:27,530 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-13 07:16:27,530 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-13 07:16:27,530 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-13 07:16:27,532 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-13 07:16:27,534 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-13 07:16:27,535 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689233187535 2023-07-13 07:16:27,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-13 07:16:27,535 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-13 07:16:27,537 DEBUG [Listener at jenkins-hbase20.apache.org/34497] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-13 07:16:27,537 DEBUG [Listener at jenkins-hbase20.apache.org/34497] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-13 07:16:27,538 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-13 07:16:27,539 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1029): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-13 07:16:27,543 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 6 msec 2023-07-13 07:16:27,545 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-13 07:16:27,547 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689233187547 2023-07-13 07:16:27,565 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-07-13 07:16:27,565 INFO [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-07-13 07:16:27,565 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 07:16:27,567 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-07-13 07:16:27,567 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-13 07:16:27,568 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-13 07:16:27,568 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-13 07:16:27,569 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:16:27,569 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:16:27,569 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:16:27,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:16:27,569 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:16:27,569 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:16:27,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:16:27,569 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:16:27,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:16:27,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-13 07:16:27,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-13 07:16:27,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-13 07:16:27,570 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-13 07:16:27,570 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-13 07:16:27,570 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-13 07:16:27,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-13 07:16:27,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-13 07:16:27,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-13 07:16:27,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-13 07:16:27,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-13 07:16:27,570 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-13 07:16:27,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-13 07:16:27,570 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-13 07:16:27,570 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-13 07:16:27,570 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-13 07:16:27,570 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-13 07:16:27,570 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 07:16:27,574 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:16:27,575 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:16:27,575 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:16:27,576 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:16:27,576 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-13 07:16:27,586 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-13 07:16:27,586 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-13 07:16:27,586 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44195,1689232541463' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-13 07:16:27,586 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-13 07:16:27,586 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-13 07:16:27,587 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-13 07:16:27,587 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-13 07:16:27,587 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 07:16:27,587 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 07:16:27,588 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-13 07:16:27,589 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-13 07:16:27,589 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,42807,1689232541407' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-13 07:16:27,589 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-13 07:16:27,589 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-13 07:16:27,589 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-13 07:16:27,589 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:16:27,589 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44607,1689232541504' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-13 07:16:27,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:16:27,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 07:16:27,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 07:16:27,589 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-13 07:16:27,589 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 07:16:27,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 07:16:27,590 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-13 07:16:27,590 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:16:27,590 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-13 07:16:27,590 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-13 07:16:27,590 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 07:16:27,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 07:16:27,590 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-13 07:16:27,590 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 07:16:27,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-13 07:16:27,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:16:27,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:16:27,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:16:27,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 07:16:27,592 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44195,1689232541463' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-13 07:16:27,592 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7b58662d[Count = 1] remaining members to acquire global barrier 2023-07-13 07:16:27,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:16:27,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 07:16:27,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 07:16:27,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 07:16:27,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 07:16:27,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-13 07:16:27,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:16:27,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:16:27,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:16:27,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 07:16:27,593 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44607,1689232541504' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-13 07:16:27,594 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7b58662d[Count = 0] remaining members to acquire global barrier 2023-07-13 07:16:27,594 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-13 07:16:27,594 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-13 07:16:27,594 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-13 07:16:27,594 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-13 07:16:27,594 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-13 07:16:27,594 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-13 07:16:27,594 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-13 07:16:27,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-13 07:16:27,594 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-13 07:16:27,595 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-13 07:16:27,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-13 07:16:27,594 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:16:27,595 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-13 07:16:27,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-13 07:16:27,595 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-13 07:16:27,595 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-13 07:16:27,595 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-13 07:16:27,595 DEBUG [rs(jenkins-hbase20.apache.org,44195,1689232541463)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689232586050.80d5300305ba23d4c38b75f529bdd008. 2023-07-13 07:16:27,595 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:16:27,595 DEBUG [rs(jenkins-hbase20.apache.org,44195,1689232541463)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689232586050.80d5300305ba23d4c38b75f529bdd008. started... 2023-07-13 07:16:27,595 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-13 07:16:27,595 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-13 07:16:27,595 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase20.apache.org,42807,1689232541407' in zk 2023-07-13 07:16:27,595 INFO [rs(jenkins-hbase20.apache.org,44195,1689232541463)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 80d5300305ba23d4c38b75f529bdd008 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-07-13 07:16:27,595 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-13 07:16:27,595 DEBUG [rs(jenkins-hbase20.apache.org,44607,1689232541504)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689232586050.d987b037d0d2f4bd939e54b622437e4b. 2023-07-13 07:16:27,595 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-13 07:16:27,595 DEBUG [rs(jenkins-hbase20.apache.org,44607,1689232541504)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689232586050.d987b037d0d2f4bd939e54b622437e4b. started... 2023-07-13 07:16:27,596 INFO [rs(jenkins-hbase20.apache.org,44607,1689232541504)-snapshot-pool-0] regionserver.HRegion(2745): Flushing d987b037d0d2f4bd939e54b622437e4b 1/1 column families, dataSize=132 B heapSize=544 B 2023-07-13 07:16:27,596 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-13 07:16:27,596 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 07:16:27,596 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-13 07:16:27,637 DEBUG [Listener at jenkins-hbase20.apache.org/34497] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 07:16:27,638 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-13 07:16:27,638 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-13 07:16:27,638 DEBUG [Listener at jenkins-hbase20.apache.org/34497] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-13 07:16:27,649 INFO [rs(jenkins-hbase20.apache.org,44195,1689232541463)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.13 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testConsecutiveExports/80d5300305ba23d4c38b75f529bdd008/.tmp/cf/99506fdc189443a59e7a671113870544 2023-07-13 07:16:27,654 INFO [rs(jenkins-hbase20.apache.org,44607,1689232541504)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=132 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testConsecutiveExports/d987b037d0d2f4bd939e54b622437e4b/.tmp/cf/cd8a399542be40309c2f76a73c221b02 2023-07-13 07:16:27,655 DEBUG [rs(jenkins-hbase20.apache.org,44195,1689232541463)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testConsecutiveExports/80d5300305ba23d4c38b75f529bdd008/.tmp/cf/99506fdc189443a59e7a671113870544 as hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testConsecutiveExports/80d5300305ba23d4c38b75f529bdd008/cf/99506fdc189443a59e7a671113870544 2023-07-13 07:16:27,661 DEBUG [rs(jenkins-hbase20.apache.org,44607,1689232541504)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testConsecutiveExports/d987b037d0d2f4bd939e54b622437e4b/.tmp/cf/cd8a399542be40309c2f76a73c221b02 as hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testConsecutiveExports/d987b037d0d2f4bd939e54b622437e4b/cf/cd8a399542be40309c2f76a73c221b02 2023-07-13 07:16:27,661 INFO [rs(jenkins-hbase20.apache.org,44195,1689232541463)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testConsecutiveExports/80d5300305ba23d4c38b75f529bdd008/cf/99506fdc189443a59e7a671113870544, entries=48, sequenceid=6, filesize=8.1 K 2023-07-13 07:16:27,663 INFO [rs(jenkins-hbase20.apache.org,44195,1689232541463)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for 80d5300305ba23d4c38b75f529bdd008 in 68ms, sequenceid=6, compaction requested=false 2023-07-13 07:16:27,663 DEBUG [rs(jenkins-hbase20.apache.org,44195,1689232541463)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-13 07:16:27,664 DEBUG [rs(jenkins-hbase20.apache.org,44195,1689232541463)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 80d5300305ba23d4c38b75f529bdd008: 2023-07-13 07:16:27,664 DEBUG [rs(jenkins-hbase20.apache.org,44195,1689232541463)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689232586050.80d5300305ba23d4c38b75f529bdd008.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-13 07:16:27,664 DEBUG [rs(jenkins-hbase20.apache.org,44195,1689232541463)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-13 07:16:27,664 DEBUG [rs(jenkins-hbase20.apache.org,44195,1689232541463)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testConsecutiveExports/80d5300305ba23d4c38b75f529bdd008/cf/99506fdc189443a59e7a671113870544] hfiles 2023-07-13 07:16:27,664 DEBUG [rs(jenkins-hbase20.apache.org,44195,1689232541463)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testConsecutiveExports/80d5300305ba23d4c38b75f529bdd008/cf/99506fdc189443a59e7a671113870544 for snapshot=snaptb0-testConsecutiveExports 2023-07-13 07:16:27,668 INFO [rs(jenkins-hbase20.apache.org,44607,1689232541504)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testConsecutiveExports/d987b037d0d2f4bd939e54b622437e4b/cf/cd8a399542be40309c2f76a73c221b02, entries=2, sequenceid=6, filesize=5.0 K 2023-07-13 07:16:27,669 INFO [rs(jenkins-hbase20.apache.org,44607,1689232541504)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for d987b037d0d2f4bd939e54b622437e4b in 73ms, sequenceid=6, compaction requested=false 2023-07-13 07:16:27,671 DEBUG [rs(jenkins-hbase20.apache.org,44607,1689232541504)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d987b037d0d2f4bd939e54b622437e4b: 2023-07-13 07:16:27,671 DEBUG [rs(jenkins-hbase20.apache.org,44607,1689232541504)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689232586050.d987b037d0d2f4bd939e54b622437e4b.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-13 07:16:27,671 DEBUG [rs(jenkins-hbase20.apache.org,44607,1689232541504)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-13 07:16:27,671 DEBUG [rs(jenkins-hbase20.apache.org,44607,1689232541504)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testConsecutiveExports/d987b037d0d2f4bd939e54b622437e4b/cf/cd8a399542be40309c2f76a73c221b02] hfiles 2023-07-13 07:16:27,671 DEBUG [rs(jenkins-hbase20.apache.org,44607,1689232541504)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testConsecutiveExports/d987b037d0d2f4bd939e54b622437e4b/cf/cd8a399542be40309c2f76a73c221b02 for snapshot=snaptb0-testConsecutiveExports 2023-07-13 07:16:27,673 DEBUG [rs(jenkins-hbase20.apache.org,44195,1689232541463)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689232586050.80d5300305ba23d4c38b75f529bdd008. completed. 2023-07-13 07:16:27,673 DEBUG [rs(jenkins-hbase20.apache.org,44195,1689232541463)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689232586050.80d5300305ba23d4c38b75f529bdd008. 2023-07-13 07:16:27,673 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-13 07:16:27,674 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-13 07:16:27,674 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:16:27,674 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-13 07:16:27,674 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase20.apache.org,44195,1689232541463' in zk 2023-07-13 07:16:27,691 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-13 07:16:27,691 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 07:16:27,691 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-13 07:16:27,693 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:16:27,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:16:27,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 07:16:27,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 07:16:27,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 07:16:27,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 07:16:27,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-13 07:16:27,696 DEBUG [rs(jenkins-hbase20.apache.org,44607,1689232541504)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689232586050.d987b037d0d2f4bd939e54b622437e4b. completed. 2023-07-13 07:16:27,696 DEBUG [rs(jenkins-hbase20.apache.org,44607,1689232541504)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689232586050.d987b037d0d2f4bd939e54b622437e4b. 2023-07-13 07:16:27,696 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-13 07:16:27,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:16:27,696 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-13 07:16:27,696 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:16:27,696 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-13 07:16:27,697 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase20.apache.org,44607,1689232541504' in zk 2023-07-13 07:16:27,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:16:27,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:16:27,701 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:16:27,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 07:16:27,701 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-13 07:16:27,702 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 07:16:27,702 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-13 07:16:27,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-13 07:16:27,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:16:27,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:16:27,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:16:27,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase20.apache.org,44195,1689232541463': 2023-07-13 07:16:27,708 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44195,1689232541463' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-13 07:16:27,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:16:27,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 07:16:27,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 07:16:27,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 07:16:27,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 07:16:27,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-13 07:16:27,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:16:27,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:16:27,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:16:27,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 07:16:27,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-13 07:16:27,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:16:27,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:16:27,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:16:27,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase20.apache.org,44607,1689232541504': 2023-07-13 07:16:27,716 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44607,1689232541504' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-13 07:16:27,716 INFO [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-07-13 07:16:27,716 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-13 07:16:27,716 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-13 07:16:27,716 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-07-13 07:16:27,716 INFO [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-13 07:16:27,729 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-13 07:16:27,729 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-13 07:16:27,729 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:16:27,729 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-13 07:16:27,729 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:16:27,730 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-13 07:16:27,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-13 07:16:27,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-13 07:16:27,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 07:16:27,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 07:16:27,730 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:16:27,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 07:16:27,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:16:27,731 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:16:27,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-13 07:16:27,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-13 07:16:27,731 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-13 07:16:27,731 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-13 07:16:27,731 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-13 07:16:27,731 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:16:27,731 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:16:27,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-13 07:16:27,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 07:16:27,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-13 07:16:27,734 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:16:27,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:16:27,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-13 07:16:27,734 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:16:27,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:16:27,734 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:16:27,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:16:27,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-13 07:16:27,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-13 07:16:27,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:16:27,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:16:27,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 07:16:27,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-13 07:16:27,737 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:16:27,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:16:27,739 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:16:27,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:16:27,739 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:16:27,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:16:27,751 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:16:27,751 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:16:27,751 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:16:27,751 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:16:27,751 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:16:27,751 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-13 07:16:27,751 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:16:27,751 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:16:27,751 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:16:27,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:16:27,751 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:16:27,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:16:27,751 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:16:27,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:16:27,751 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-07-13 07:16:27,752 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-07-13 07:16:27,752 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:16:27,751 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 07:16:27,752 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:16:27,751 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-13 07:16:27,754 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:16:27,754 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-13 07:16:27,754 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:16:27,754 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:16:27,754 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-13 07:16:27,754 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-13 07:16:27,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:16:27,752 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:16:27,754 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:16:27,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:16:27,754 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:16:27,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:16:27,755 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-13 07:16:27,792 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-13 07:16:27,833 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-13 07:16:27,833 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-13 07:16:27,833 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-13 07:16:27,833 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689232587535Consolidate snapshot: snaptb0-testConsecutiveExports at 1689232587752 (+217 ms)Loading Region manifests for snaptb0-testConsecutiveExports at 1689232587752Writing data manifest for snaptb0-testConsecutiveExports at 1689232587773 (+21 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1689232587785 (+12 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689232587833 (+48 ms) 2023-07-13 07:16:27,835 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-13 07:16:27,837 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 299 msec 2023-07-13 07:16:27,839 DEBUG [Listener at jenkins-hbase20.apache.org/34497] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 07:16:27,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-13 07:16:27,840 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-13 07:16:27,840 INFO [Listener at jenkins-hbase20.apache.org/34497] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a827846-4542-2630-0c34-c6bc20d13d68/local-export-1689232587840 2023-07-13 07:16:27,840 INFO [Listener at jenkins-hbase20.apache.org/34497] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a827846-4542-2630-0c34-c6bc20d13d68/local-export-1689232587840, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a827846-4542-2630-0c34-c6bc20d13d68/local-export-1689232587840, srcFsUri=hdfs://localhost.localdomain:40681, srcDir=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e 2023-07-13 07:16:27,859 DEBUG [Listener at jenkins-hbase20.apache.org/34497] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost.localdomain:40681, inputRoot=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e 2023-07-13 07:16:27,860 DEBUG [Listener at jenkins-hbase20.apache.org/34497] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@205b40e1, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a827846-4542-2630-0c34-c6bc20d13d68/local-export-1689232587840, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a827846-4542-2630-0c34-c6bc20d13d68/local-export-1689232587840/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-13 07:16:27,860 INFO [Listener at jenkins-hbase20.apache.org/34497] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost.localdomain:40681, inputRoot=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e, snapshotDir=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-13 07:16:27,867 INFO [Listener at jenkins-hbase20.apache.org/34497] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a827846-4542-2630-0c34-c6bc20d13d68/local-export-1689232587840/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-13 07:16:27,878 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-13 07:16:27,878 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-13 07:16:27,878 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-13 07:16:27,879 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-13 07:16:27,879 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-13 07:16:27,879 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-13 07:16:27,880 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-13 07:16:27,939 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a827846-4542-2630-0c34-c6bc20d13d68/hadoop-6120130065348744557.jar 2023-07-13 07:16:27,940 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-13 07:16:27,940 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-13 07:16:27,941 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-13 07:16:27,941 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-13 07:16:27,942 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-13 07:16:27,942 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-13 07:16:27,942 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-13 07:16:27,943 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-13 07:16:27,944 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-13 07:16:27,944 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-13 07:16:27,945 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-13 07:16:27,945 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-13 07:16:27,945 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-13 07:16:27,946 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-13 07:16:27,947 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-13 07:16:27,947 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-13 07:16:27,948 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-13 07:16:27,948 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-13 07:16:27,949 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-13 07:16:27,949 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-13 07:16:27,950 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-13 07:16:27,950 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-13 07:16:27,951 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-13 07:16:29,229 WARN [Listener at jenkins-hbase20.apache.org/34497] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-13 07:16:29,232 INFO [Listener at jenkins-hbase20.apache.org/34497] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-13 07:16:29,236 DEBUG [Listener at jenkins-hbase20.apache.org/34497] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-13 07:16:29,883 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-13 07:16:29,883 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-13 07:16:29,886 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689232548306_0002_000001 (auth:SIMPLE) 2023-07-13 07:16:30,676 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689232548306_0003_000001 (auth:SIMPLE) 2023-07-13 07:16:31,388 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-13 07:16:34,955 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689232548306_0003_000001 (auth:SIMPLE) 2023-07-13 07:16:37,191 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689232548306_0003_000001 (auth:SIMPLE) 2023-07-13 07:16:39,700 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689232548306_0003_000001 (auth:SIMPLE) 2023-07-13 07:16:41,454 INFO [Listener at jenkins-hbase20.apache.org/34497] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-13 07:16:41,454 INFO [Listener at jenkins-hbase20.apache.org/34497] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-13 07:16:41,457 INFO [Listener at jenkins-hbase20.apache.org/34497] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-13 07:16:41,458 INFO [Listener at jenkins-hbase20.apache.org/34497] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-13 07:16:41,458 INFO [Listener at jenkins-hbase20.apache.org/34497] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-13 07:16:41,459 DEBUG [Listener at jenkins-hbase20.apache.org/34497] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_139625932_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-13 07:16:41,459 DEBUG [Listener at jenkins-hbase20.apache.org/34497] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-13 07:16:41,459 DEBUG [Listener at jenkins-hbase20.apache.org/34497] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-13 07:16:41,459 DEBUG [Listener at jenkins-hbase20.apache.org/34497] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@92001b4 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a827846-4542-2630-0c34-c6bc20d13d68/local-export-1689232587840/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a827846-4542-2630-0c34-c6bc20d13d68/local-export-1689232587840/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-13 07:16:41,460 DEBUG [Listener at jenkins-hbase20.apache.org/34497] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a827846-4542-2630-0c34-c6bc20d13d68/local-export-1689232587840/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-13 07:16:41,460 DEBUG [Listener at jenkins-hbase20.apache.org/34497] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a827846-4542-2630-0c34-c6bc20d13d68/local-export-1689232587840/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-13 07:16:41,461 INFO [Listener at jenkins-hbase20.apache.org/34497] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a827846-4542-2630-0c34-c6bc20d13d68/local-export-1689232587840, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a827846-4542-2630-0c34-c6bc20d13d68/local-export-1689232587840, srcFsUri=hdfs://localhost.localdomain:40681, srcDir=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e 2023-07-13 07:16:41,482 DEBUG [Listener at jenkins-hbase20.apache.org/34497] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost.localdomain:40681, inputRoot=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e 2023-07-13 07:16:41,482 DEBUG [Listener at jenkins-hbase20.apache.org/34497] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@482cf118, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a827846-4542-2630-0c34-c6bc20d13d68/local-export-1689232587840, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a827846-4542-2630-0c34-c6bc20d13d68/local-export-1689232587840/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-13 07:16:41,482 INFO [Listener at jenkins-hbase20.apache.org/34497] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost.localdomain:40681, inputRoot=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e, snapshotDir=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-13 07:16:41,496 INFO [Listener at jenkins-hbase20.apache.org/34497] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a827846-4542-2630-0c34-c6bc20d13d68/local-export-1689232587840/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-13 07:16:41,507 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-13 07:16:41,507 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-13 07:16:41,508 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-13 07:16:41,508 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-13 07:16:41,509 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-13 07:16:41,509 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-13 07:16:41,509 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-13 07:16:41,579 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a827846-4542-2630-0c34-c6bc20d13d68/hadoop-8075976611340427455.jar 2023-07-13 07:16:41,580 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-13 07:16:41,580 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-13 07:16:41,581 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-13 07:16:41,581 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-13 07:16:41,582 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-13 07:16:41,582 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-13 07:16:41,583 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-13 07:16:41,583 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-13 07:16:41,584 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-13 07:16:41,584 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-13 07:16:41,584 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-13 07:16:41,585 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-13 07:16:41,585 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-13 07:16:41,585 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-13 07:16:41,586 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-13 07:16:41,586 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-13 07:16:41,586 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-13 07:16:41,587 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-13 07:16:41,587 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-13 07:16:41,587 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-13 07:16:41,587 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-13 07:16:41,588 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-13 07:16:41,588 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-13 07:16:42,395 WARN [Listener at jenkins-hbase20.apache.org/34497] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-13 07:16:42,397 INFO [Listener at jenkins-hbase20.apache.org/34497] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-13 07:16:42,399 DEBUG [Listener at jenkins-hbase20.apache.org/34497] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-13 07:16:45,880 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-13 07:16:45,881 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-13 07:16:45,884 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689232548306_0003_000001 (auth:SIMPLE) 2023-07-13 07:16:45,901 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689232548306_0004_000001 (auth:SIMPLE) 2023-07-13 07:16:49,595 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689232548306_0004_000001 (auth:SIMPLE) 2023-07-13 07:16:51,833 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689232548306_0004_000001 (auth:SIMPLE) 2023-07-13 07:16:56,617 INFO [Listener at jenkins-hbase20.apache.org/34497] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-13 07:16:56,617 INFO [Listener at jenkins-hbase20.apache.org/34497] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-13 07:16:56,627 INFO [Listener at jenkins-hbase20.apache.org/34497] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-13 07:16:56,627 INFO [Listener at jenkins-hbase20.apache.org/34497] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-13 07:16:56,628 INFO [Listener at jenkins-hbase20.apache.org/34497] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-13 07:16:56,628 DEBUG [Listener at jenkins-hbase20.apache.org/34497] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_139625932_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-13 07:16:56,631 DEBUG [Listener at jenkins-hbase20.apache.org/34497] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-13 07:16:56,631 DEBUG [Listener at jenkins-hbase20.apache.org/34497] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-13 07:16:56,631 DEBUG [Listener at jenkins-hbase20.apache.org/34497] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@92001b4 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a827846-4542-2630-0c34-c6bc20d13d68/local-export-1689232587840/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a827846-4542-2630-0c34-c6bc20d13d68/local-export-1689232587840/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-13 07:16:56,631 DEBUG [Listener at jenkins-hbase20.apache.org/34497] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a827846-4542-2630-0c34-c6bc20d13d68/local-export-1689232587840/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-13 07:16:56,631 DEBUG [Listener at jenkins-hbase20.apache.org/34497] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a827846-4542-2630-0c34-c6bc20d13d68/local-export-1689232587840/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-13 07:16:56,644 INFO [Listener at jenkins-hbase20.apache.org/34497] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-07-13 07:16:56,645 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testtb-testConsecutiveExports 2023-07-13 07:16:56,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] procedure2.ProcedureExecutor(1029): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-07-13 07:16:56,650 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-13 07:16:56,650 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689232616650"}]},"ts":"1689232616650"} 2023-07-13 07:16:56,652 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-07-13 07:16:56,653 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-07-13 07:16:56,654 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=d987b037d0d2f4bd939e54b622437e4b, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=80d5300305ba23d4c38b75f529bdd008, UNASSIGN}] 2023-07-13 07:16:56,656 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=d987b037d0d2f4bd939e54b622437e4b, UNASSIGN 2023-07-13 07:16:56,656 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=80d5300305ba23d4c38b75f529bdd008, UNASSIGN 2023-07-13 07:16:56,657 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=80d5300305ba23d4c38b75f529bdd008, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:16:56,657 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=d987b037d0d2f4bd939e54b622437e4b, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:16:56,657 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689232586050.80d5300305ba23d4c38b75f529bdd008.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689232616657"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689232616657"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689232616657"}]},"ts":"1689232616657"} 2023-07-13 07:16:56,657 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689232586050.d987b037d0d2f4bd939e54b622437e4b.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689232616657"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689232616657"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689232616657"}]},"ts":"1689232616657"} 2023-07-13 07:16:56,659 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=54, ppid=53, state=RUNNABLE; CloseRegionProcedure 80d5300305ba23d4c38b75f529bdd008, server=jenkins-hbase20.apache.org,44195,1689232541463}] 2023-07-13 07:16:56,661 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=55, ppid=52, state=RUNNABLE; CloseRegionProcedure d987b037d0d2f4bd939e54b622437e4b, server=jenkins-hbase20.apache.org,44607,1689232541504}] 2023-07-13 07:16:56,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-13 07:16:56,814 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 80d5300305ba23d4c38b75f529bdd008 2023-07-13 07:16:56,814 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 80d5300305ba23d4c38b75f529bdd008, disabling compactions & flushes 2023-07-13 07:16:56,815 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689232586050.80d5300305ba23d4c38b75f529bdd008. 2023-07-13 07:16:56,815 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689232586050.80d5300305ba23d4c38b75f529bdd008. 2023-07-13 07:16:56,815 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689232586050.80d5300305ba23d4c38b75f529bdd008. after waiting 0 ms 2023-07-13 07:16:56,815 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689232586050.80d5300305ba23d4c38b75f529bdd008. 2023-07-13 07:16:56,819 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close d987b037d0d2f4bd939e54b622437e4b 2023-07-13 07:16:56,819 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing d987b037d0d2f4bd939e54b622437e4b, disabling compactions & flushes 2023-07-13 07:16:56,819 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689232586050.d987b037d0d2f4bd939e54b622437e4b. 2023-07-13 07:16:56,819 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689232586050.d987b037d0d2f4bd939e54b622437e4b. 2023-07-13 07:16:56,819 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689232586050.d987b037d0d2f4bd939e54b622437e4b. after waiting 0 ms 2023-07-13 07:16:56,819 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689232586050.d987b037d0d2f4bd939e54b622437e4b. 2023-07-13 07:16:56,867 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testConsecutiveExports/d987b037d0d2f4bd939e54b622437e4b/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-13 07:16:56,868 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-13 07:16:56,872 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689232586050.d987b037d0d2f4bd939e54b622437e4b. 2023-07-13 07:16:56,872 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for d987b037d0d2f4bd939e54b622437e4b: 2023-07-13 07:16:56,873 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testConsecutiveExports/80d5300305ba23d4c38b75f529bdd008/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-13 07:16:56,874 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-13 07:16:56,876 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689232586050.80d5300305ba23d4c38b75f529bdd008. 2023-07-13 07:16:56,876 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 80d5300305ba23d4c38b75f529bdd008: 2023-07-13 07:16:56,878 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed d987b037d0d2f4bd939e54b622437e4b 2023-07-13 07:16:56,879 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=d987b037d0d2f4bd939e54b622437e4b, regionState=CLOSED 2023-07-13 07:16:56,879 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689232586050.d987b037d0d2f4bd939e54b622437e4b.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689232616879"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689232616879"}]},"ts":"1689232616879"} 2023-07-13 07:16:56,880 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 80d5300305ba23d4c38b75f529bdd008 2023-07-13 07:16:56,882 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=80d5300305ba23d4c38b75f529bdd008, regionState=CLOSED 2023-07-13 07:16:56,882 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689232586050.80d5300305ba23d4c38b75f529bdd008.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689232616882"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689232616882"}]},"ts":"1689232616882"} 2023-07-13 07:16:56,891 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=55, resume processing ppid=52 2023-07-13 07:16:56,891 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=55, ppid=52, state=SUCCESS; CloseRegionProcedure d987b037d0d2f4bd939e54b622437e4b, server=jenkins-hbase20.apache.org,44607,1689232541504 in 221 msec 2023-07-13 07:16:56,893 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=54, resume processing ppid=53 2023-07-13 07:16:56,893 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=54, ppid=53, state=SUCCESS; CloseRegionProcedure 80d5300305ba23d4c38b75f529bdd008, server=jenkins-hbase20.apache.org,44195,1689232541463 in 225 msec 2023-07-13 07:16:56,894 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=d987b037d0d2f4bd939e54b622437e4b, UNASSIGN in 237 msec 2023-07-13 07:16:56,895 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=51 2023-07-13 07:16:56,895 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=80d5300305ba23d4c38b75f529bdd008, UNASSIGN in 239 msec 2023-07-13 07:16:56,896 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689232616896"}]},"ts":"1689232616896"} 2023-07-13 07:16:56,899 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-07-13 07:16:56,901 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-07-13 07:16:56,907 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 259 msec 2023-07-13 07:16:56,952 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-13 07:16:56,953 INFO [Listener at jenkins-hbase20.apache.org/34497] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-07-13 07:16:56,954 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.HMaster$5(2228): Client=jenkins//148.251.75.209 delete testtb-testConsecutiveExports 2023-07-13 07:16:56,955 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] procedure2.ProcedureExecutor(1029): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-13 07:16:56,957 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-13 07:16:56,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-07-13 07:16:56,959 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-13 07:16:56,961 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44607] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-07-13 07:16:56,963 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-13 07:16:56,963 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-13 07:16:56,963 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-13 07:16:56,963 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-13 07:16:56,963 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-13 07:16:56,964 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-13 07:16:56,964 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-13 07:16:56,964 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-13 07:16:56,964 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-13 07:16:56,964 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-13 07:16:56,964 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 07:16:56,964 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 07:16:56,964 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-13 07:16:56,964 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 07:16:56,965 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-13 07:16:56,965 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 07:16:56,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-13 07:16:56,965 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testConsecutiveExports/d987b037d0d2f4bd939e54b622437e4b 2023-07-13 07:16:56,965 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testConsecutiveExports/80d5300305ba23d4c38b75f529bdd008 2023-07-13 07:16:56,967 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testConsecutiveExports/d987b037d0d2f4bd939e54b622437e4b/cf, FileablePath, hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testConsecutiveExports/d987b037d0d2f4bd939e54b622437e4b/recovered.edits] 2023-07-13 07:16:56,967 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testConsecutiveExports/80d5300305ba23d4c38b75f529bdd008/cf, FileablePath, hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testConsecutiveExports/80d5300305ba23d4c38b75f529bdd008/recovered.edits] 2023-07-13 07:16:56,970 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testConsecutiveExports/d987b037d0d2f4bd939e54b622437e4b/cf/cd8a399542be40309c2f76a73c221b02 to hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/archive/data/default/testtb-testConsecutiveExports/d987b037d0d2f4bd939e54b622437e4b/cf/cd8a399542be40309c2f76a73c221b02 2023-07-13 07:16:56,970 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testConsecutiveExports/80d5300305ba23d4c38b75f529bdd008/cf/99506fdc189443a59e7a671113870544 to hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/archive/data/default/testtb-testConsecutiveExports/80d5300305ba23d4c38b75f529bdd008/cf/99506fdc189443a59e7a671113870544 2023-07-13 07:16:56,973 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testConsecutiveExports/80d5300305ba23d4c38b75f529bdd008/recovered.edits/9.seqid to hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/archive/data/default/testtb-testConsecutiveExports/80d5300305ba23d4c38b75f529bdd008/recovered.edits/9.seqid 2023-07-13 07:16:56,974 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testConsecutiveExports/80d5300305ba23d4c38b75f529bdd008 2023-07-13 07:16:56,976 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testConsecutiveExports/d987b037d0d2f4bd939e54b622437e4b/recovered.edits/9.seqid to hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/archive/data/default/testtb-testConsecutiveExports/d987b037d0d2f4bd939e54b622437e4b/recovered.edits/9.seqid 2023-07-13 07:16:56,976 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testConsecutiveExports/d987b037d0d2f4bd939e54b622437e4b 2023-07-13 07:16:56,977 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-13 07:16:56,979 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-13 07:16:56,982 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-07-13 07:16:56,984 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-07-13 07:16:56,985 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-13 07:16:56,986 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-07-13 07:16:56,986 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1689232586050.d987b037d0d2f4bd939e54b622437e4b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689232616986"}]},"ts":"9223372036854775807"} 2023-07-13 07:16:56,986 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1689232586050.80d5300305ba23d4c38b75f529bdd008.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689232616986"}]},"ts":"9223372036854775807"} 2023-07-13 07:16:56,988 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-13 07:16:56,988 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => d987b037d0d2f4bd939e54b622437e4b, NAME => 'testtb-testConsecutiveExports,,1689232586050.d987b037d0d2f4bd939e54b622437e4b.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 80d5300305ba23d4c38b75f529bdd008, NAME => 'testtb-testConsecutiveExports,1,1689232586050.80d5300305ba23d4c38b75f529bdd008.', STARTKEY => '1', ENDKEY => ''}] 2023-07-13 07:16:56,988 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-07-13 07:16:56,988 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689232616988"}]},"ts":"9223372036854775807"} 2023-07-13 07:16:56,990 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-07-13 07:16:56,992 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-13 07:16:56,993 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 38 msec 2023-07-13 07:16:57,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-13 07:16:57,067 INFO [Listener at jenkins-hbase20.apache.org/34497] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-07-13 07:16:57,080 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "emptySnaptb0-testConsecutiveExports" 2023-07-13 07:16:57,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-07-13 07:16:57,086 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "snaptb0-testConsecutiveExports" 2023-07-13 07:16:57,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-07-13 07:16:57,113 INFO [Listener at jenkins-hbase20.apache.org/34497] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testConsecutiveExports Thread=749 (was 762), OpenFileDescriptor=914 (was 931), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=508 (was 493) - SystemLoadAverage LEAK? -, ProcessCount=170 (was 169) - ProcessCount LEAK? -, AvailableMemoryMB=3985 (was 3562) - AvailableMemoryMB LEAK? - 2023-07-13 07:16:57,114 WARN [Listener at jenkins-hbase20.apache.org/34497] hbase.ResourceChecker(130): Thread=749 is superior to 500 2023-07-13 07:16:57,133 INFO [Listener at jenkins-hbase20.apache.org/34497] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=749, OpenFileDescriptor=914, MaxFileDescriptor=60000, SystemLoadAverage=508, ProcessCount=170, AvailableMemoryMB=3978 2023-07-13 07:16:57,133 WARN [Listener at jenkins-hbase20.apache.org/34497] hbase.ResourceChecker(130): Thread=749 is superior to 500 2023-07-13 07:16:57,135 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-13 07:16:57,137 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] procedure2.ProcedureExecutor(1029): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:57,142 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-07-13 07:16:57,142 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-07-13 07:16:57,144 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-13 07:16:57,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-13 07:16:57,150 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/1b4802ed4d3dee1e2a4da4cb99644369 2023-07-13 07:16:57,152 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/1b4802ed4d3dee1e2a4da4cb99644369 empty. 2023-07-13 07:16:57,153 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/1b4802ed4d3dee1e2a4da4cb99644369 2023-07-13 07:16:57,152 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/02e1f115dcd2a0d93b9d3bac5716fcc5 2023-07-13 07:16:57,154 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/02e1f115dcd2a0d93b9d3bac5716fcc5 empty. 2023-07-13 07:16:57,154 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/02e1f115dcd2a0d93b9d3bac5716fcc5 2023-07-13 07:16:57,155 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-13 07:16:57,188 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-07-13 07:16:57,195 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => 1b4802ed4d3dee1e2a4da4cb99644369, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689232617134.1b4802ed4d3dee1e2a4da4cb99644369.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp 2023-07-13 07:16:57,195 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => 02e1f115dcd2a0d93b9d3bac5716fcc5, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689232617134.02e1f115dcd2a0d93b9d3bac5716fcc5.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp 2023-07-13 07:16:57,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-13 07:16:57,247 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689232617134.02e1f115dcd2a0d93b9d3bac5716fcc5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 07:16:57,248 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing 02e1f115dcd2a0d93b9d3bac5716fcc5, disabling compactions & flushes 2023-07-13 07:16:57,248 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689232617134.02e1f115dcd2a0d93b9d3bac5716fcc5. 2023-07-13 07:16:57,248 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689232617134.02e1f115dcd2a0d93b9d3bac5716fcc5. 2023-07-13 07:16:57,248 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689232617134.02e1f115dcd2a0d93b9d3bac5716fcc5. after waiting 0 ms 2023-07-13 07:16:57,248 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689232617134.02e1f115dcd2a0d93b9d3bac5716fcc5. 2023-07-13 07:16:57,248 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689232617134.02e1f115dcd2a0d93b9d3bac5716fcc5. 2023-07-13 07:16:57,248 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for 02e1f115dcd2a0d93b9d3bac5716fcc5: 2023-07-13 07:16:57,251 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689232617134.1b4802ed4d3dee1e2a4da4cb99644369.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 07:16:57,251 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing 1b4802ed4d3dee1e2a4da4cb99644369, disabling compactions & flushes 2023-07-13 07:16:57,252 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689232617134.1b4802ed4d3dee1e2a4da4cb99644369. 2023-07-13 07:16:57,252 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689232617134.1b4802ed4d3dee1e2a4da4cb99644369. 2023-07-13 07:16:57,252 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689232617134.1b4802ed4d3dee1e2a4da4cb99644369. after waiting 0 ms 2023-07-13 07:16:57,252 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689232617134.1b4802ed4d3dee1e2a4da4cb99644369. 2023-07-13 07:16:57,252 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689232617134.1b4802ed4d3dee1e2a4da4cb99644369. 2023-07-13 07:16:57,252 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for 1b4802ed4d3dee1e2a4da4cb99644369: 2023-07-13 07:16:57,255 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-07-13 07:16:57,256 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689232617134.02e1f115dcd2a0d93b9d3bac5716fcc5.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689232617256"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689232617256"}]},"ts":"1689232617256"} 2023-07-13 07:16:57,256 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689232617134.1b4802ed4d3dee1e2a4da4cb99644369.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689232617256"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689232617256"}]},"ts":"1689232617256"} 2023-07-13 07:16:57,269 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-13 07:16:57,270 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-13 07:16:57,270 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689232617270"}]},"ts":"1689232617270"} 2023-07-13 07:16:57,272 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-07-13 07:16:57,275 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-07-13 07:16:57,276 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-13 07:16:57,276 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-13 07:16:57,276 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-13 07:16:57,277 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-13 07:16:57,277 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=1b4802ed4d3dee1e2a4da4cb99644369, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=02e1f115dcd2a0d93b9d3bac5716fcc5, ASSIGN}] 2023-07-13 07:16:57,280 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=1b4802ed4d3dee1e2a4da4cb99644369, ASSIGN 2023-07-13 07:16:57,280 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=02e1f115dcd2a0d93b9d3bac5716fcc5, ASSIGN 2023-07-13 07:16:57,282 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=1b4802ed4d3dee1e2a4da4cb99644369, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,44195,1689232541463; forceNewPlan=false, retain=false 2023-07-13 07:16:57,282 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=02e1f115dcd2a0d93b9d3bac5716fcc5, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,42807,1689232541407; forceNewPlan=false, retain=false 2023-07-13 07:16:57,432 INFO [jenkins-hbase20:37475] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-13 07:16:57,435 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=02e1f115dcd2a0d93b9d3bac5716fcc5, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:16:57,435 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=1b4802ed4d3dee1e2a4da4cb99644369, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:16:57,435 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689232617134.02e1f115dcd2a0d93b9d3bac5716fcc5.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689232617435"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689232617435"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689232617435"}]},"ts":"1689232617435"} 2023-07-13 07:16:57,435 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689232617134.1b4802ed4d3dee1e2a4da4cb99644369.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689232617435"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689232617435"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689232617435"}]},"ts":"1689232617435"} 2023-07-13 07:16:57,437 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=58, state=RUNNABLE; OpenRegionProcedure 1b4802ed4d3dee1e2a4da4cb99644369, server=jenkins-hbase20.apache.org,44195,1689232541463}] 2023-07-13 07:16:57,438 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=59, state=RUNNABLE; OpenRegionProcedure 02e1f115dcd2a0d93b9d3bac5716fcc5, server=jenkins-hbase20.apache.org,42807,1689232541407}] 2023-07-13 07:16:57,447 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-13 07:16:57,594 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1689232617134.1b4802ed4d3dee1e2a4da4cb99644369. 2023-07-13 07:16:57,595 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1b4802ed4d3dee1e2a4da4cb99644369, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689232617134.1b4802ed4d3dee1e2a4da4cb99644369.', STARTKEY => '', ENDKEY => '1'} 2023-07-13 07:16:57,597 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1689232617134.1b4802ed4d3dee1e2a4da4cb99644369. service=AccessControlService 2023-07-13 07:16:57,597 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-13 07:16:57,597 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 1b4802ed4d3dee1e2a4da4cb99644369 2023-07-13 07:16:57,597 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689232617134.1b4802ed4d3dee1e2a4da4cb99644369.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 07:16:57,597 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 1b4802ed4d3dee1e2a4da4cb99644369 2023-07-13 07:16:57,597 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 1b4802ed4d3dee1e2a4da4cb99644369 2023-07-13 07:16:57,598 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1689232617134.02e1f115dcd2a0d93b9d3bac5716fcc5. 2023-07-13 07:16:57,598 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 02e1f115dcd2a0d93b9d3bac5716fcc5, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689232617134.02e1f115dcd2a0d93b9d3bac5716fcc5.', STARTKEY => '1', ENDKEY => ''} 2023-07-13 07:16:57,598 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1689232617134.02e1f115dcd2a0d93b9d3bac5716fcc5. service=AccessControlService 2023-07-13 07:16:57,599 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-13 07:16:57,599 INFO [StoreOpener-1b4802ed4d3dee1e2a4da4cb99644369-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 1b4802ed4d3dee1e2a4da4cb99644369 2023-07-13 07:16:57,599 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 02e1f115dcd2a0d93b9d3bac5716fcc5 2023-07-13 07:16:57,599 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689232617134.02e1f115dcd2a0d93b9d3bac5716fcc5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 07:16:57,599 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 02e1f115dcd2a0d93b9d3bac5716fcc5 2023-07-13 07:16:57,599 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 02e1f115dcd2a0d93b9d3bac5716fcc5 2023-07-13 07:16:57,600 INFO [StoreOpener-02e1f115dcd2a0d93b9d3bac5716fcc5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 02e1f115dcd2a0d93b9d3bac5716fcc5 2023-07-13 07:16:57,601 DEBUG [StoreOpener-1b4802ed4d3dee1e2a4da4cb99644369-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testExportFileSystemStateWithMergeRegion/1b4802ed4d3dee1e2a4da4cb99644369/cf 2023-07-13 07:16:57,601 DEBUG [StoreOpener-1b4802ed4d3dee1e2a4da4cb99644369-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testExportFileSystemStateWithMergeRegion/1b4802ed4d3dee1e2a4da4cb99644369/cf 2023-07-13 07:16:57,602 DEBUG [StoreOpener-02e1f115dcd2a0d93b9d3bac5716fcc5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testExportFileSystemStateWithMergeRegion/02e1f115dcd2a0d93b9d3bac5716fcc5/cf 2023-07-13 07:16:57,602 DEBUG [StoreOpener-02e1f115dcd2a0d93b9d3bac5716fcc5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testExportFileSystemStateWithMergeRegion/02e1f115dcd2a0d93b9d3bac5716fcc5/cf 2023-07-13 07:16:57,602 INFO [StoreOpener-1b4802ed4d3dee1e2a4da4cb99644369-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1b4802ed4d3dee1e2a4da4cb99644369 columnFamilyName cf 2023-07-13 07:16:57,602 INFO [StoreOpener-02e1f115dcd2a0d93b9d3bac5716fcc5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 02e1f115dcd2a0d93b9d3bac5716fcc5 columnFamilyName cf 2023-07-13 07:16:57,603 INFO [StoreOpener-1b4802ed4d3dee1e2a4da4cb99644369-1] regionserver.HStore(310): Store=1b4802ed4d3dee1e2a4da4cb99644369/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-13 07:16:57,603 INFO [StoreOpener-02e1f115dcd2a0d93b9d3bac5716fcc5-1] regionserver.HStore(310): Store=02e1f115dcd2a0d93b9d3bac5716fcc5/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-13 07:16:57,604 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testExportFileSystemStateWithMergeRegion/1b4802ed4d3dee1e2a4da4cb99644369 2023-07-13 07:16:57,604 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testExportFileSystemStateWithMergeRegion/02e1f115dcd2a0d93b9d3bac5716fcc5 2023-07-13 07:16:57,604 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testExportFileSystemStateWithMergeRegion/1b4802ed4d3dee1e2a4da4cb99644369 2023-07-13 07:16:57,604 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testExportFileSystemStateWithMergeRegion/02e1f115dcd2a0d93b9d3bac5716fcc5 2023-07-13 07:16:57,607 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 1b4802ed4d3dee1e2a4da4cb99644369 2023-07-13 07:16:57,607 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 02e1f115dcd2a0d93b9d3bac5716fcc5 2023-07-13 07:16:57,612 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testExportFileSystemStateWithMergeRegion/1b4802ed4d3dee1e2a4da4cb99644369/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-13 07:16:57,612 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testExportFileSystemStateWithMergeRegion/02e1f115dcd2a0d93b9d3bac5716fcc5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-13 07:16:57,613 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 1b4802ed4d3dee1e2a4da4cb99644369; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70375146, jitterRate=0.04867139458656311}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-13 07:16:57,613 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 02e1f115dcd2a0d93b9d3bac5716fcc5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69437955, jitterRate=0.03470616042613983}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-13 07:16:57,613 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 1b4802ed4d3dee1e2a4da4cb99644369: 2023-07-13 07:16:57,613 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 02e1f115dcd2a0d93b9d3bac5716fcc5: 2023-07-13 07:16:57,614 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1689232617134.1b4802ed4d3dee1e2a4da4cb99644369., pid=60, masterSystemTime=1689232617589 2023-07-13 07:16:57,614 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1689232617134.02e1f115dcd2a0d93b9d3bac5716fcc5., pid=61, masterSystemTime=1689232617590 2023-07-13 07:16:57,616 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1689232617134.02e1f115dcd2a0d93b9d3bac5716fcc5. 2023-07-13 07:16:57,616 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1689232617134.02e1f115dcd2a0d93b9d3bac5716fcc5. 2023-07-13 07:16:57,616 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=02e1f115dcd2a0d93b9d3bac5716fcc5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:16:57,616 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1689232617134.1b4802ed4d3dee1e2a4da4cb99644369. 2023-07-13 07:16:57,616 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1689232617134.1b4802ed4d3dee1e2a4da4cb99644369. 2023-07-13 07:16:57,616 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689232617134.02e1f115dcd2a0d93b9d3bac5716fcc5.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689232617616"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689232617616"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689232617616"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689232617616"}]},"ts":"1689232617616"} 2023-07-13 07:16:57,617 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=1b4802ed4d3dee1e2a4da4cb99644369, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:16:57,617 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689232617134.1b4802ed4d3dee1e2a4da4cb99644369.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689232617617"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689232617617"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689232617617"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689232617617"}]},"ts":"1689232617617"} 2023-07-13 07:16:57,625 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=59 2023-07-13 07:16:57,625 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=59, state=SUCCESS; OpenRegionProcedure 02e1f115dcd2a0d93b9d3bac5716fcc5, server=jenkins-hbase20.apache.org,42807,1689232541407 in 180 msec 2023-07-13 07:16:57,625 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=58 2023-07-13 07:16:57,625 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=58, state=SUCCESS; OpenRegionProcedure 1b4802ed4d3dee1e2a4da4cb99644369, server=jenkins-hbase20.apache.org,44195,1689232541463 in 187 msec 2023-07-13 07:16:57,626 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=02e1f115dcd2a0d93b9d3bac5716fcc5, ASSIGN in 348 msec 2023-07-13 07:16:57,627 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=58, resume processing ppid=57 2023-07-13 07:16:57,627 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=1b4802ed4d3dee1e2a4da4cb99644369, ASSIGN in 349 msec 2023-07-13 07:16:57,628 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-13 07:16:57,628 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689232617628"}]},"ts":"1689232617628"} 2023-07-13 07:16:57,629 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-07-13 07:16:57,631 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-07-13 07:16:57,632 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-07-13 07:16:57,634 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44607] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-13 07:16:57,635 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 07:16:57,635 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 07:16:57,635 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 07:16:57,635 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 07:16:57,636 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-13 07:16:57,636 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-13 07:16:57,636 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-13 07:16:57,636 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-13 07:16:57,638 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 501 msec 2023-07-13 07:16:57,748 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-13 07:16:57,749 INFO [Listener at jenkins-hbase20.apache.org/34497] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-07-13 07:16:57,749 DEBUG [Listener at jenkins-hbase20.apache.org/34497] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemStateWithMergeRegion get assigned. Timeout = 60000ms 2023-07-13 07:16:57,749 INFO [Listener at jenkins-hbase20.apache.org/34497] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-13 07:16:57,752 INFO [Listener at jenkins-hbase20.apache.org/34497] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemStateWithMergeRegion assigned to meta. Checking AM states. 2023-07-13 07:16:57,752 INFO [Listener at jenkins-hbase20.apache.org/34497] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-13 07:16:57,752 INFO [Listener at jenkins-hbase20.apache.org/34497] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemStateWithMergeRegion assigned. 2023-07-13 07:16:57,757 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-13 07:16:57,757 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689232617757 (current time:1689232617757). 2023-07-13 07:16:57,757 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-13 07:16:57,758 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] zookeeper.ReadOnlyZKClient(139): Connect 0x79248c2e to 127.0.0.1:58099 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-13 07:16:57,765 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@69ef05df, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-13 07:16:57,766 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 07:16:57,769 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:52578, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 07:16:57,770 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x79248c2e to 127.0.0.1:58099 2023-07-13 07:16:57,770 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 07:16:57,771 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] zookeeper.ReadOnlyZKClient(139): Connect 0x1b830105 to 127.0.0.1:58099 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-13 07:16:57,777 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@469baba7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-13 07:16:57,778 DEBUG [hconnection-0x574b8f56-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 07:16:57,779 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:52580, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 07:16:57,784 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 07:16:57,787 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:40946, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 07:16:57,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1b830105 to 127.0.0.1:58099 2023-07-13 07:16:57,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 07:16:57,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-13 07:16:57,789 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-13 07:16:57,789 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-13 07:16:57,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] procedure2.ProcedureExecutor(1029): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-13 07:16:57,793 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-13 07:16:57,794 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689233217794 2023-07-13 07:16:57,794 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-13 07:16:57,794 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:57,795 DEBUG [Listener at jenkins-hbase20.apache.org/34497] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-13 07:16:57,795 DEBUG [Listener at jenkins-hbase20.apache.org/34497] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-13 07:16:57,797 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-13 07:16:57,797 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1029): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-13 07:16:57,798 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 7 msec 2023-07-13 07:16:57,799 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-13 07:16:57,800 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689233217800 2023-07-13 07:16:57,816 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:57,816 INFO [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-13 07:16:57,816 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 07:16:57,818 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-13 07:16:57,818 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-13 07:16:57,818 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:57,818 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:57,819 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:16:57,819 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:16:57,819 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:16:57,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:16:57,819 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:16:57,819 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:16:57,819 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:16:57,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:16:57,819 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:16:57,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:16:57,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:57,820 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:16:57,820 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:16:57,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:57,820 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:57,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:57,820 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:16:57,820 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-13 07:16:57,820 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:57,820 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:57,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-13 07:16:57,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:57,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-13 07:16:57,820 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-13 07:16:57,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:57,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-13 07:16:57,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:57,820 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-13 07:16:57,820 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:57,820 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-13 07:16:57,821 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-13 07:16:57,821 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:57,821 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 07:16:57,821 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-13 07:16:57,821 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 07:16:57,822 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:57,822 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-13 07:16:57,823 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-13 07:16:57,823 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-13 07:16:57,823 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-13 07:16:57,823 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-13 07:16:57,823 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,42807,1689232541407' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-13 07:16:57,823 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 07:16:57,823 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44607,1689232541504' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-13 07:16:57,825 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-13 07:16:57,825 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-13 07:16:57,825 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44195,1689232541463' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-13 07:16:57,832 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:57,832 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:57,832 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:57,832 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:57,833 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 07:16:57,833 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:16:57,833 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:16:57,833 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:57,833 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:57,833 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 07:16:57,833 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 07:16:57,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:16:57,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 07:16:57,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 07:16:57,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 07:16:57,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 07:16:57,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:57,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:16:57,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:16:57,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:16:57,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 07:16:57,836 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44195,1689232541463' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-13 07:16:57,836 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@15ea924[Count = 1] remaining members to acquire global barrier 2023-07-13 07:16:57,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:16:57,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 07:16:57,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 07:16:57,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 07:16:57,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 07:16:57,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:57,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:16:57,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:16:57,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:16:57,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 07:16:57,838 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,42807,1689232541407' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-13 07:16:57,838 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@15ea924[Count = 0] remaining members to acquire global barrier 2023-07-13 07:16:57,838 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-13 07:16:57,839 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:57,846 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:57,846 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:57,846 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:57,846 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:57,846 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:16:57,846 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:57,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:57,846 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:57,846 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-13 07:16:57,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:57,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:57,846 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-13 07:16:57,846 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-13 07:16:57,846 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-13 07:16:57,846 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:16:57,846 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-13 07:16:57,846 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-13 07:16:57,846 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-13 07:16:57,846 DEBUG [rs(jenkins-hbase20.apache.org,42807,1689232541407)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689232617134.02e1f115dcd2a0d93b9d3bac5716fcc5. 2023-07-13 07:16:57,846 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-13 07:16:57,846 DEBUG [rs(jenkins-hbase20.apache.org,42807,1689232541407)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689232617134.02e1f115dcd2a0d93b9d3bac5716fcc5. started... 2023-07-13 07:16:57,846 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-13 07:16:57,846 DEBUG [rs(jenkins-hbase20.apache.org,44195,1689232541463)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689232617134.1b4802ed4d3dee1e2a4da4cb99644369. 2023-07-13 07:16:57,847 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase20.apache.org,44607,1689232541504' in zk 2023-07-13 07:16:57,848 DEBUG [rs(jenkins-hbase20.apache.org,42807,1689232541407)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 02e1f115dcd2a0d93b9d3bac5716fcc5: 2023-07-13 07:16:57,848 DEBUG [rs(jenkins-hbase20.apache.org,44195,1689232541463)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689232617134.1b4802ed4d3dee1e2a4da4cb99644369. started... 2023-07-13 07:16:57,849 DEBUG [rs(jenkins-hbase20.apache.org,44195,1689232541463)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 1b4802ed4d3dee1e2a4da4cb99644369: 2023-07-13 07:16:57,849 DEBUG [rs(jenkins-hbase20.apache.org,42807,1689232541407)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689232617134.02e1f115dcd2a0d93b9d3bac5716fcc5.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:57,849 DEBUG [rs(jenkins-hbase20.apache.org,42807,1689232541407)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-13 07:16:57,850 DEBUG [rs(jenkins-hbase20.apache.org,42807,1689232541407)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-13 07:16:57,850 DEBUG [rs(jenkins-hbase20.apache.org,44195,1689232541463)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689232617134.1b4802ed4d3dee1e2a4da4cb99644369.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:57,850 DEBUG [rs(jenkins-hbase20.apache.org,44195,1689232541463)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-13 07:16:57,850 DEBUG [rs(jenkins-hbase20.apache.org,44195,1689232541463)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-13 07:16:57,857 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-13 07:16:57,857 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 07:16:57,857 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-13 07:16:57,858 DEBUG [rs(jenkins-hbase20.apache.org,42807,1689232541407)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689232617134.02e1f115dcd2a0d93b9d3bac5716fcc5. completed. 2023-07-13 07:16:57,862 DEBUG [rs(jenkins-hbase20.apache.org,42807,1689232541407)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689232617134.02e1f115dcd2a0d93b9d3bac5716fcc5. 2023-07-13 07:16:57,863 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-13 07:16:57,863 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-13 07:16:57,863 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:16:57,863 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-13 07:16:57,863 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase20.apache.org,42807,1689232541407' in zk 2023-07-13 07:16:57,864 DEBUG [rs(jenkins-hbase20.apache.org,44195,1689232541463)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689232617134.1b4802ed4d3dee1e2a4da4cb99644369. completed. 2023-07-13 07:16:57,865 DEBUG [rs(jenkins-hbase20.apache.org,44195,1689232541463)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689232617134.1b4802ed4d3dee1e2a4da4cb99644369. 2023-07-13 07:16:57,865 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-13 07:16:57,865 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-13 07:16:57,865 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:16:57,865 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-13 07:16:57,865 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase20.apache.org,44195,1689232541463' in zk 2023-07-13 07:16:57,867 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-13 07:16:57,867 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:16:57,867 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 07:16:57,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:16:57,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 07:16:57,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 07:16:57,867 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-13 07:16:57,869 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:16:57,869 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-13 07:16:57,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 07:16:57,869 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 07:16:57,869 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-13 07:16:57,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 07:16:57,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:57,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:16:57,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:16:57,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:16:57,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 07:16:57,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:57,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:16:57,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:16:57,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:16:57,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase20.apache.org,42807,1689232541407': 2023-07-13 07:16:57,874 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,42807,1689232541407' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-13 07:16:57,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:16:57,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 07:16:57,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 07:16:57,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 07:16:57,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 07:16:57,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:57,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:16:57,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:16:57,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:16:57,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 07:16:57,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:57,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:16:57,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:16:57,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:16:57,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase20.apache.org,44195,1689232541463': 2023-07-13 07:16:57,880 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44195,1689232541463' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-13 07:16:57,880 INFO [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-13 07:16:57,880 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-13 07:16:57,880 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-13 07:16:57,880 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:57,880 INFO [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-13 07:16:57,881 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:57,881 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:57,881 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:57,882 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:57,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:57,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 07:16:57,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 07:16:57,882 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:16:57,881 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:57,881 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:16:57,881 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:57,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:57,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:57,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 07:16:57,882 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:16:57,882 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:57,882 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:16:57,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:57,883 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:16:57,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:16:57,883 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:16:57,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:16:57,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:57,883 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:16:57,883 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:16:57,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:16:57,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:57,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:57,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 07:16:57,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:57,884 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:16:57,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:57,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:16:57,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:16:57,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:16:57,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 07:16:57,886 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:16:57,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:57,887 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:16:57,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:16:57,887 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:16:57,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:16:57,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:16:57,889 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:16:57,890 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:16:57,890 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:16:57,890 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:16:57,890 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:16:57,890 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:16:57,890 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:16:57,890 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:16:57,890 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 07:16:57,890 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:16:57,890 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:16:57,890 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:57,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:16:57,892 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:57,890 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:57,892 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:16:57,892 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:16:57,892 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:57,892 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:16:57,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:16:57,892 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:57,892 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:16:57,892 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:16:57,892 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:16:57,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:16:57,892 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:16:57,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:16:57,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:16:57,892 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:57,893 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:57,893 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:57,893 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:16:57,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:16:57,897 DEBUG [Listener at jenkins-hbase20.apache.org/34497] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 07:16:57,898 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-13 07:16:57,898 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-13 07:16:57,898 DEBUG [Listener at jenkins-hbase20.apache.org/34497] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-13 07:16:57,929 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:57,957 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-13 07:16:57,958 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:57,958 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:57,958 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689232617794Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689232617892 (+98 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689232617892Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689232617906 (+14 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689232617923 (+17 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689232617957 (+34 ms) 2023-07-13 07:16:57,961 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-13 07:16:57,962 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 166 msec 2023-07-13 07:16:58,098 DEBUG [Listener at jenkins-hbase20.apache.org/34497] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 07:16:58,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-13 07:16:58,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-13 07:16:58,115 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44195] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1689232617134.1b4802ed4d3dee1e2a4da4cb99644369. with WAL disabled. Data may be lost in the event of a crash. 2023-07-13 07:16:58,116 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42807] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1689232617134.02e1f115dcd2a0d93b9d3bac5716fcc5. with WAL disabled. Data may be lost in the event of a crash. 2023-07-13 07:16:58,119 DEBUG [Listener at jenkins-hbase20.apache.org/34497] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:58,120 DEBUG [Listener at jenkins-hbase20.apache.org/34497] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1689232617134.1b4802ed4d3dee1e2a4da4cb99644369. 2023-07-13 07:16:58,121 INFO [Listener at jenkins-hbase20.apache.org/34497] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-13 07:16:58,138 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-13 07:16:58,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689232618138 (current time:1689232618138). 2023-07-13 07:16:58,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-13 07:16:58,139 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] zookeeper.ReadOnlyZKClient(139): Connect 0x19c4281d to 127.0.0.1:58099 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-13 07:16:58,151 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4da159b4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-13 07:16:58,152 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 07:16:58,156 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:52596, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 07:16:58,157 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x19c4281d to 127.0.0.1:58099 2023-07-13 07:16:58,158 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 07:16:58,158 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] zookeeper.ReadOnlyZKClient(139): Connect 0x3c2d72a6 to 127.0.0.1:58099 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-13 07:16:58,172 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@41121fe, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-13 07:16:58,173 DEBUG [hconnection-0x433ab431-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 07:16:58,177 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:52602, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 07:16:58,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 07:16:58,185 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:40958, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 07:16:58,186 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3c2d72a6 to 127.0.0.1:58099 2023-07-13 07:16:58,186 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 07:16:58,186 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-13 07:16:58,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-13 07:16:58,188 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-13 07:16:58,190 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-13 07:16:58,191 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-13 07:16:58,192 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689233218192 2023-07-13 07:16:58,192 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:58,192 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-13 07:16:58,194 DEBUG [Listener at jenkins-hbase20.apache.org/34497] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-13 07:16:58,194 DEBUG [Listener at jenkins-hbase20.apache.org/34497] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-13 07:16:58,194 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-13 07:16:58,196 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-13 07:16:58,197 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 7 msec 2023-07-13 07:16:58,199 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-13 07:16:58,199 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689233218199 2023-07-13 07:16:58,212 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:58,212 INFO [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-13 07:16:58,212 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 07:16:58,213 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-13 07:16:58,213 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-13 07:16:58,214 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:58,214 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:58,215 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:16:58,215 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:16:58,215 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:16:58,215 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:16:58,215 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:16:58,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:16:58,215 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:16:58,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:16:58,215 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:16:58,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:16:58,215 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:16:58,215 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:16:58,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:58,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:58,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:58,216 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:58,216 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:16:58,216 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-13 07:16:58,216 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:58,216 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:58,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-13 07:16:58,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:58,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-13 07:16:58,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:58,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-13 07:16:58,216 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-13 07:16:58,216 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-13 07:16:58,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:58,216 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-13 07:16:58,217 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:58,217 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:58,217 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-13 07:16:58,217 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-13 07:16:58,217 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 07:16:58,217 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 07:16:58,217 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:58,218 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-13 07:16:58,219 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-13 07:16:58,219 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-13 07:16:58,219 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-13 07:16:58,219 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-13 07:16:58,219 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44195,1689232541463' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-13 07:16:58,219 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,42807,1689232541407' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-13 07:16:58,220 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 07:16:58,221 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-13 07:16:58,221 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-13 07:16:58,221 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44607,1689232541504' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-13 07:16:58,229 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:58,229 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:16:58,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:16:58,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 07:16:58,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 07:16:58,233 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:16:58,234 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:58,233 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:58,234 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 07:16:58,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 07:16:58,234 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:58,234 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:58,234 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 07:16:58,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 07:16:58,234 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:58,234 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 07:16:58,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:58,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:16:58,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:16:58,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:16:58,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 07:16:58,235 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44195,1689232541463' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-13 07:16:58,236 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@71e1fcda[Count = 1] remaining members to acquire global barrier 2023-07-13 07:16:58,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:16:58,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 07:16:58,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 07:16:58,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 07:16:58,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 07:16:58,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:58,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:16:58,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:16:58,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:16:58,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 07:16:58,240 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,42807,1689232541407' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-13 07:16:58,240 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@71e1fcda[Count = 0] remaining members to acquire global barrier 2023-07-13 07:16:58,240 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-13 07:16:58,240 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:58,246 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:58,246 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:58,246 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:58,246 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:58,246 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:58,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:58,246 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:16:58,246 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:58,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:58,246 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-13 07:16:58,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:58,246 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-13 07:16:58,246 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-13 07:16:58,246 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-13 07:16:58,246 DEBUG [rs(jenkins-hbase20.apache.org,42807,1689232541407)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689232617134.02e1f115dcd2a0d93b9d3bac5716fcc5. 2023-07-13 07:16:58,246 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-13 07:16:58,247 DEBUG [rs(jenkins-hbase20.apache.org,44195,1689232541463)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689232617134.1b4802ed4d3dee1e2a4da4cb99644369. 2023-07-13 07:16:58,246 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:16:58,247 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-13 07:16:58,247 DEBUG [rs(jenkins-hbase20.apache.org,44195,1689232541463)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689232617134.1b4802ed4d3dee1e2a4da4cb99644369. started... 2023-07-13 07:16:58,247 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-13 07:16:58,247 DEBUG [rs(jenkins-hbase20.apache.org,42807,1689232541407)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689232617134.02e1f115dcd2a0d93b9d3bac5716fcc5. started... 2023-07-13 07:16:58,246 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-13 07:16:58,246 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-13 07:16:58,247 INFO [rs(jenkins-hbase20.apache.org,44195,1689232541463)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 1b4802ed4d3dee1e2a4da4cb99644369 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-13 07:16:58,247 INFO [rs(jenkins-hbase20.apache.org,42807,1689232541407)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 02e1f115dcd2a0d93b9d3bac5716fcc5 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-13 07:16:58,247 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase20.apache.org,44607,1689232541504' in zk 2023-07-13 07:16:58,250 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-13 07:16:58,250 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 07:16:58,250 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-13 07:16:58,267 INFO [rs(jenkins-hbase20.apache.org,42807,1689232541407)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.00 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testExportFileSystemStateWithMergeRegion/02e1f115dcd2a0d93b9d3bac5716fcc5/.tmp/cf/8f910e83986d434b9f9693e5db825269 2023-07-13 07:16:58,274 INFO [rs(jenkins-hbase20.apache.org,44195,1689232541463)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=266 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testExportFileSystemStateWithMergeRegion/1b4802ed4d3dee1e2a4da4cb99644369/.tmp/cf/109b8b3833ac457abf2366dc1f514165 2023-07-13 07:16:58,275 DEBUG [rs(jenkins-hbase20.apache.org,42807,1689232541407)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testExportFileSystemStateWithMergeRegion/02e1f115dcd2a0d93b9d3bac5716fcc5/.tmp/cf/8f910e83986d434b9f9693e5db825269 as hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testExportFileSystemStateWithMergeRegion/02e1f115dcd2a0d93b9d3bac5716fcc5/cf/8f910e83986d434b9f9693e5db825269 2023-07-13 07:16:58,280 DEBUG [rs(jenkins-hbase20.apache.org,44195,1689232541463)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testExportFileSystemStateWithMergeRegion/1b4802ed4d3dee1e2a4da4cb99644369/.tmp/cf/109b8b3833ac457abf2366dc1f514165 as hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testExportFileSystemStateWithMergeRegion/1b4802ed4d3dee1e2a4da4cb99644369/cf/109b8b3833ac457abf2366dc1f514165 2023-07-13 07:16:58,280 INFO [rs(jenkins-hbase20.apache.org,42807,1689232541407)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testExportFileSystemStateWithMergeRegion/02e1f115dcd2a0d93b9d3bac5716fcc5/cf/8f910e83986d434b9f9693e5db825269, entries=46, sequenceid=6, filesize=7.9 K 2023-07-13 07:16:58,284 INFO [rs(jenkins-hbase20.apache.org,42807,1689232541407)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 02e1f115dcd2a0d93b9d3bac5716fcc5 in 36ms, sequenceid=6, compaction requested=false 2023-07-13 07:16:58,284 DEBUG [rs(jenkins-hbase20.apache.org,42807,1689232541407)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-07-13 07:16:58,284 DEBUG [rs(jenkins-hbase20.apache.org,42807,1689232541407)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 02e1f115dcd2a0d93b9d3bac5716fcc5: 2023-07-13 07:16:58,284 DEBUG [rs(jenkins-hbase20.apache.org,42807,1689232541407)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689232617134.02e1f115dcd2a0d93b9d3bac5716fcc5.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:58,284 DEBUG [rs(jenkins-hbase20.apache.org,42807,1689232541407)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-13 07:16:58,284 DEBUG [rs(jenkins-hbase20.apache.org,42807,1689232541407)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testExportFileSystemStateWithMergeRegion/02e1f115dcd2a0d93b9d3bac5716fcc5/cf/8f910e83986d434b9f9693e5db825269] hfiles 2023-07-13 07:16:58,284 DEBUG [rs(jenkins-hbase20.apache.org,42807,1689232541407)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testExportFileSystemStateWithMergeRegion/02e1f115dcd2a0d93b9d3bac5716fcc5/cf/8f910e83986d434b9f9693e5db825269 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:58,287 INFO [rs(jenkins-hbase20.apache.org,44195,1689232541463)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testExportFileSystemStateWithMergeRegion/1b4802ed4d3dee1e2a4da4cb99644369/cf/109b8b3833ac457abf2366dc1f514165, entries=4, sequenceid=6, filesize=5.1 K 2023-07-13 07:16:58,288 INFO [rs(jenkins-hbase20.apache.org,44195,1689232541463)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 1b4802ed4d3dee1e2a4da4cb99644369 in 41ms, sequenceid=6, compaction requested=false 2023-07-13 07:16:58,290 DEBUG [rs(jenkins-hbase20.apache.org,44195,1689232541463)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 1b4802ed4d3dee1e2a4da4cb99644369: 2023-07-13 07:16:58,290 DEBUG [rs(jenkins-hbase20.apache.org,44195,1689232541463)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689232617134.1b4802ed4d3dee1e2a4da4cb99644369.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:58,290 DEBUG [rs(jenkins-hbase20.apache.org,44195,1689232541463)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-13 07:16:58,290 DEBUG [rs(jenkins-hbase20.apache.org,44195,1689232541463)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testExportFileSystemStateWithMergeRegion/1b4802ed4d3dee1e2a4da4cb99644369/cf/109b8b3833ac457abf2366dc1f514165] hfiles 2023-07-13 07:16:58,290 DEBUG [rs(jenkins-hbase20.apache.org,44195,1689232541463)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testExportFileSystemStateWithMergeRegion/1b4802ed4d3dee1e2a4da4cb99644369/cf/109b8b3833ac457abf2366dc1f514165 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:58,296 DEBUG [Listener at jenkins-hbase20.apache.org/34497] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 07:16:58,297 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-13 07:16:58,297 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-13 07:16:58,297 DEBUG [Listener at jenkins-hbase20.apache.org/34497] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-13 07:16:58,302 DEBUG [rs(jenkins-hbase20.apache.org,42807,1689232541407)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689232617134.02e1f115dcd2a0d93b9d3bac5716fcc5. completed. 2023-07-13 07:16:58,303 DEBUG [rs(jenkins-hbase20.apache.org,42807,1689232541407)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689232617134.02e1f115dcd2a0d93b9d3bac5716fcc5. 2023-07-13 07:16:58,303 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-13 07:16:58,303 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-13 07:16:58,303 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:16:58,303 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-13 07:16:58,303 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase20.apache.org,42807,1689232541407' in zk 2023-07-13 07:16:58,304 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:16:58,304 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-13 07:16:58,304 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 07:16:58,304 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-13 07:16:58,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:16:58,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 07:16:58,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 07:16:58,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 07:16:58,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 07:16:58,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:58,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:16:58,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:16:58,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:16:58,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 07:16:58,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:58,309 DEBUG [rs(jenkins-hbase20.apache.org,44195,1689232541463)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689232617134.1b4802ed4d3dee1e2a4da4cb99644369. completed. 2023-07-13 07:16:58,309 DEBUG [rs(jenkins-hbase20.apache.org,44195,1689232541463)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689232617134.1b4802ed4d3dee1e2a4da4cb99644369. 2023-07-13 07:16:58,309 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-13 07:16:58,309 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-13 07:16:58,309 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:16:58,309 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-13 07:16:58,309 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase20.apache.org,44195,1689232541463' in zk 2023-07-13 07:16:58,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:16:58,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:16:58,319 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-13 07:16:58,319 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:16:58,319 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 07:16:58,319 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-13 07:16:58,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase20.apache.org,42807,1689232541407': 2023-07-13 07:16:58,321 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,42807,1689232541407' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-13 07:16:58,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:16:58,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 07:16:58,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 07:16:58,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 07:16:58,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 07:16:58,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:58,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:16:58,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:16:58,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:16:58,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 07:16:58,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:58,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:16:58,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:16:58,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:16:58,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase20.apache.org,44195,1689232541463': 2023-07-13 07:16:58,324 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44195,1689232541463' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-13 07:16:58,324 INFO [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-13 07:16:58,324 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-13 07:16:58,324 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-13 07:16:58,324 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:58,324 INFO [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-13 07:16:58,325 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:58,325 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:58,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:58,325 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:58,325 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:16:58,325 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:58,325 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:58,325 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:16:58,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:58,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 07:16:58,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 07:16:58,325 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:58,325 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:16:58,325 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:58,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:58,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 07:16:58,326 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:16:58,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:58,326 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:16:58,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:16:58,326 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:16:58,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:16:58,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:58,326 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:16:58,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:58,326 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:16:58,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:16:58,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:58,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 07:16:58,327 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:16:58,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:58,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:58,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:16:58,329 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:16:58,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:16:58,330 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:16:58,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:16:58,330 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:16:58,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 07:16:58,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:58,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:16:58,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:16:58,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:16:58,334 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:16:58,334 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:16:58,334 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:16:58,334 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:16:58,334 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:58,334 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:16:58,334 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:16:58,334 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:16:58,334 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:16:58,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:16:58,335 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 07:16:58,335 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:58,334 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:16:58,336 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:58,334 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:16:58,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:16:58,334 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:16:58,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:16:58,337 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:16:58,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:16:58,337 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:16:58,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:16:58,334 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:16:58,337 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:58,337 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:16:58,337 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:58,337 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:16:58,338 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:16:58,338 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:58,338 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:58,338 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:58,338 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:16:58,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:16:58,370 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:58,396 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-13 07:16:58,396 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:58,397 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:16:58,397 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689232618192Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689232618336 (+144 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1689232618336Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1689232618345 (+9 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689232618361 (+16 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689232618396 (+35 ms) 2023-07-13 07:16:58,400 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-13 07:16:58,401 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 206 msec 2023-07-13 07:16:58,497 DEBUG [Listener at jenkins-hbase20.apache.org/34497] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 07:16:58,499 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-13 07:16:58,499 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-13 07:16:58,534 DEBUG [Listener at jenkins-hbase20.apache.org/34497] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-13 07:16:58,538 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:36228, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-13 07:16:58,539 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42807] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-13 07:16:58,540 DEBUG [Listener at jenkins-hbase20.apache.org/34497] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-13 07:16:58,543 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:52616, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-13 07:16:58,543 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44195] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-13 07:16:58,544 DEBUG [Listener at jenkins-hbase20.apache.org/34497] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-13 07:16:58,548 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:40962, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-13 07:16:58,548 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44607] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-13 07:16:58,551 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-13 07:16:58,552 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] procedure2.ProcedureExecutor(1029): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:16:58,555 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-07-13 07:16:58,555 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-07-13 07:16:58,555 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-13 07:16:58,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-13 07:16:58,558 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bb6a1de6c33e9b4d0a93922c18bdc355 2023-07-13 07:16:58,558 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bb6a1de6c33e9b4d0a93922c18bdc355 empty. 2023-07-13 07:16:58,558 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a9e99b22a8a7456b79dc7b2070c918b3 2023-07-13 07:16:58,559 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bb6a1de6c33e9b4d0a93922c18bdc355 2023-07-13 07:16:58,559 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a9e99b22a8a7456b79dc7b2070c918b3 empty. 2023-07-13 07:16:58,559 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a9e99b22a8a7456b79dc7b2070c918b3 2023-07-13 07:16:58,559 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-13 07:16:58,571 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-07-13 07:16:58,572 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => a9e99b22a8a7456b79dc7b2070c918b3, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689232618550.a9e99b22a8a7456b79dc7b2070c918b3.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp 2023-07-13 07:16:58,572 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => bb6a1de6c33e9b4d0a93922c18bdc355, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689232618550.bb6a1de6c33e9b4d0a93922c18bdc355.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp 2023-07-13 07:16:58,592 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689232618550.a9e99b22a8a7456b79dc7b2070c918b3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 07:16:58,592 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing a9e99b22a8a7456b79dc7b2070c918b3, disabling compactions & flushes 2023-07-13 07:16:58,593 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689232618550.a9e99b22a8a7456b79dc7b2070c918b3. 2023-07-13 07:16:58,593 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689232618550.bb6a1de6c33e9b4d0a93922c18bdc355.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 07:16:58,593 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689232618550.a9e99b22a8a7456b79dc7b2070c918b3. 2023-07-13 07:16:58,593 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing bb6a1de6c33e9b4d0a93922c18bdc355, disabling compactions & flushes 2023-07-13 07:16:58,593 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689232618550.a9e99b22a8a7456b79dc7b2070c918b3. after waiting 0 ms 2023-07-13 07:16:58,593 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689232618550.a9e99b22a8a7456b79dc7b2070c918b3. 2023-07-13 07:16:58,593 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689232618550.bb6a1de6c33e9b4d0a93922c18bdc355. 2023-07-13 07:16:58,593 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689232618550.a9e99b22a8a7456b79dc7b2070c918b3. 2023-07-13 07:16:58,593 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689232618550.bb6a1de6c33e9b4d0a93922c18bdc355. 2023-07-13 07:16:58,593 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for a9e99b22a8a7456b79dc7b2070c918b3: 2023-07-13 07:16:58,593 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689232618550.bb6a1de6c33e9b4d0a93922c18bdc355. after waiting 0 ms 2023-07-13 07:16:58,593 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689232618550.bb6a1de6c33e9b4d0a93922c18bdc355. 2023-07-13 07:16:58,593 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689232618550.bb6a1de6c33e9b4d0a93922c18bdc355. 2023-07-13 07:16:58,593 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for bb6a1de6c33e9b4d0a93922c18bdc355: 2023-07-13 07:16:58,595 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-07-13 07:16:58,596 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689232618550.a9e99b22a8a7456b79dc7b2070c918b3.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689232618596"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689232618596"}]},"ts":"1689232618596"} 2023-07-13 07:16:58,596 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689232618550.bb6a1de6c33e9b4d0a93922c18bdc355.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689232618596"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689232618596"}]},"ts":"1689232618596"} 2023-07-13 07:16:58,598 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-13 07:16:58,600 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-13 07:16:58,600 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689232618600"}]},"ts":"1689232618600"} 2023-07-13 07:16:58,601 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-07-13 07:16:58,603 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-07-13 07:16:58,605 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-13 07:16:58,605 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-13 07:16:58,605 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-13 07:16:58,605 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-13 07:16:58,605 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=bb6a1de6c33e9b4d0a93922c18bdc355, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a9e99b22a8a7456b79dc7b2070c918b3, ASSIGN}] 2023-07-13 07:16:58,607 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a9e99b22a8a7456b79dc7b2070c918b3, ASSIGN 2023-07-13 07:16:58,607 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=bb6a1de6c33e9b4d0a93922c18bdc355, ASSIGN 2023-07-13 07:16:58,608 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a9e99b22a8a7456b79dc7b2070c918b3, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,44607,1689232541504; forceNewPlan=false, retain=false 2023-07-13 07:16:58,608 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=bb6a1de6c33e9b4d0a93922c18bdc355, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,42807,1689232541407; forceNewPlan=false, retain=false 2023-07-13 07:16:58,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-13 07:16:58,758 INFO [jenkins-hbase20:37475] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-13 07:16:58,761 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=a9e99b22a8a7456b79dc7b2070c918b3, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:16:58,761 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=bb6a1de6c33e9b4d0a93922c18bdc355, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:16:58,762 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689232618550.a9e99b22a8a7456b79dc7b2070c918b3.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689232618761"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689232618761"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689232618761"}]},"ts":"1689232618761"} 2023-07-13 07:16:58,762 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689232618550.bb6a1de6c33e9b4d0a93922c18bdc355.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689232618761"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689232618761"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689232618761"}]},"ts":"1689232618761"} 2023-07-13 07:16:58,763 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=68, state=RUNNABLE; OpenRegionProcedure a9e99b22a8a7456b79dc7b2070c918b3, server=jenkins-hbase20.apache.org,44607,1689232541504}] 2023-07-13 07:16:58,764 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=70, ppid=67, state=RUNNABLE; OpenRegionProcedure bb6a1de6c33e9b4d0a93922c18bdc355, server=jenkins-hbase20.apache.org,42807,1689232541407}] 2023-07-13 07:16:58,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-13 07:16:58,919 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1689232618550.a9e99b22a8a7456b79dc7b2070c918b3. 2023-07-13 07:16:58,919 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a9e99b22a8a7456b79dc7b2070c918b3, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689232618550.a9e99b22a8a7456b79dc7b2070c918b3.', STARTKEY => '2', ENDKEY => ''} 2023-07-13 07:16:58,919 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689232618550.bb6a1de6c33e9b4d0a93922c18bdc355. 2023-07-13 07:16:58,920 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => bb6a1de6c33e9b4d0a93922c18bdc355, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689232618550.bb6a1de6c33e9b4d0a93922c18bdc355.', STARTKEY => '', ENDKEY => '2'} 2023-07-13 07:16:58,920 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1689232618550.a9e99b22a8a7456b79dc7b2070c918b3. service=AccessControlService 2023-07-13 07:16:58,920 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689232618550.bb6a1de6c33e9b4d0a93922c18bdc355. service=AccessControlService 2023-07-13 07:16:58,921 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-13 07:16:58,921 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-13 07:16:58,921 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 a9e99b22a8a7456b79dc7b2070c918b3 2023-07-13 07:16:58,921 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 bb6a1de6c33e9b4d0a93922c18bdc355 2023-07-13 07:16:58,921 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689232618550.a9e99b22a8a7456b79dc7b2070c918b3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 07:16:58,921 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689232618550.bb6a1de6c33e9b4d0a93922c18bdc355.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 07:16:58,921 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for a9e99b22a8a7456b79dc7b2070c918b3 2023-07-13 07:16:58,921 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for bb6a1de6c33e9b4d0a93922c18bdc355 2023-07-13 07:16:58,921 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for a9e99b22a8a7456b79dc7b2070c918b3 2023-07-13 07:16:58,921 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for bb6a1de6c33e9b4d0a93922c18bdc355 2023-07-13 07:16:58,926 INFO [StoreOpener-a9e99b22a8a7456b79dc7b2070c918b3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region a9e99b22a8a7456b79dc7b2070c918b3 2023-07-13 07:16:58,926 INFO [StoreOpener-bb6a1de6c33e9b4d0a93922c18bdc355-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region bb6a1de6c33e9b4d0a93922c18bdc355 2023-07-13 07:16:58,928 DEBUG [StoreOpener-a9e99b22a8a7456b79dc7b2070c918b3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a9e99b22a8a7456b79dc7b2070c918b3/cf 2023-07-13 07:16:58,928 DEBUG [StoreOpener-bb6a1de6c33e9b4d0a93922c18bdc355-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bb6a1de6c33e9b4d0a93922c18bdc355/cf 2023-07-13 07:16:58,928 DEBUG [StoreOpener-bb6a1de6c33e9b4d0a93922c18bdc355-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bb6a1de6c33e9b4d0a93922c18bdc355/cf 2023-07-13 07:16:58,928 DEBUG [StoreOpener-a9e99b22a8a7456b79dc7b2070c918b3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a9e99b22a8a7456b79dc7b2070c918b3/cf 2023-07-13 07:16:58,928 INFO [StoreOpener-bb6a1de6c33e9b4d0a93922c18bdc355-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bb6a1de6c33e9b4d0a93922c18bdc355 columnFamilyName cf 2023-07-13 07:16:58,928 INFO [StoreOpener-a9e99b22a8a7456b79dc7b2070c918b3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a9e99b22a8a7456b79dc7b2070c918b3 columnFamilyName cf 2023-07-13 07:16:58,929 INFO [StoreOpener-bb6a1de6c33e9b4d0a93922c18bdc355-1] regionserver.HStore(310): Store=bb6a1de6c33e9b4d0a93922c18bdc355/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-13 07:16:58,929 INFO [StoreOpener-a9e99b22a8a7456b79dc7b2070c918b3-1] regionserver.HStore(310): Store=a9e99b22a8a7456b79dc7b2070c918b3/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-13 07:16:58,930 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bb6a1de6c33e9b4d0a93922c18bdc355 2023-07-13 07:16:58,930 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a9e99b22a8a7456b79dc7b2070c918b3 2023-07-13 07:16:58,930 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bb6a1de6c33e9b4d0a93922c18bdc355 2023-07-13 07:16:58,930 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a9e99b22a8a7456b79dc7b2070c918b3 2023-07-13 07:16:58,933 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for bb6a1de6c33e9b4d0a93922c18bdc355 2023-07-13 07:16:58,933 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for a9e99b22a8a7456b79dc7b2070c918b3 2023-07-13 07:16:58,935 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a9e99b22a8a7456b79dc7b2070c918b3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-13 07:16:58,936 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened a9e99b22a8a7456b79dc7b2070c918b3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70669794, jitterRate=0.053061991930007935}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-13 07:16:58,936 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bb6a1de6c33e9b4d0a93922c18bdc355/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-13 07:16:58,936 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for a9e99b22a8a7456b79dc7b2070c918b3: 2023-07-13 07:16:58,936 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened bb6a1de6c33e9b4d0a93922c18bdc355; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61245935, jitterRate=-0.08736445009708405}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-13 07:16:58,936 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for bb6a1de6c33e9b4d0a93922c18bdc355: 2023-07-13 07:16:58,937 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689232618550.bb6a1de6c33e9b4d0a93922c18bdc355., pid=70, masterSystemTime=1689232618917 2023-07-13 07:16:58,939 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689232618550.a9e99b22a8a7456b79dc7b2070c918b3., pid=69, masterSystemTime=1689232618916 2023-07-13 07:16:58,939 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689232618550.bb6a1de6c33e9b4d0a93922c18bdc355. 2023-07-13 07:16:58,939 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689232618550.bb6a1de6c33e9b4d0a93922c18bdc355. 2023-07-13 07:16:58,940 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=bb6a1de6c33e9b4d0a93922c18bdc355, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:16:58,940 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689232618550.bb6a1de6c33e9b4d0a93922c18bdc355.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689232618940"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689232618940"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689232618940"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689232618940"}]},"ts":"1689232618940"} 2023-07-13 07:16:58,942 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689232618550.a9e99b22a8a7456b79dc7b2070c918b3. 2023-07-13 07:16:58,942 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1689232618550.a9e99b22a8a7456b79dc7b2070c918b3. 2023-07-13 07:16:58,943 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=a9e99b22a8a7456b79dc7b2070c918b3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:16:58,943 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689232618550.a9e99b22a8a7456b79dc7b2070c918b3.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689232618942"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689232618942"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689232618942"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689232618942"}]},"ts":"1689232618942"} 2023-07-13 07:16:58,948 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=70, resume processing ppid=67 2023-07-13 07:16:58,949 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=70, ppid=67, state=SUCCESS; OpenRegionProcedure bb6a1de6c33e9b4d0a93922c18bdc355, server=jenkins-hbase20.apache.org,42807,1689232541407 in 178 msec 2023-07-13 07:16:58,950 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=68 2023-07-13 07:16:58,950 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=bb6a1de6c33e9b4d0a93922c18bdc355, ASSIGN in 344 msec 2023-07-13 07:16:58,950 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=68, state=SUCCESS; OpenRegionProcedure a9e99b22a8a7456b79dc7b2070c918b3, server=jenkins-hbase20.apache.org,44607,1689232541504 in 182 msec 2023-07-13 07:16:58,952 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=68, resume processing ppid=66 2023-07-13 07:16:58,952 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a9e99b22a8a7456b79dc7b2070c918b3, ASSIGN in 345 msec 2023-07-13 07:16:58,952 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-13 07:16:58,953 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689232618952"}]},"ts":"1689232618952"} 2023-07-13 07:16:58,954 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-07-13 07:16:58,956 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-07-13 07:16:58,956 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-07-13 07:16:58,958 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44607] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-13 07:16:58,959 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 07:16:58,959 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 07:16:58,959 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 07:16:58,959 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 07:16:58,961 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-13 07:16:58,961 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-13 07:16:58,961 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-13 07:16:58,961 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-13 07:16:58,961 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-13 07:16:58,961 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-13 07:16:58,961 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-13 07:16:58,962 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-13 07:16:58,963 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 410 msec 2023-07-13 07:16:59,161 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-13 07:16:59,161 INFO [Listener at jenkins-hbase20.apache.org/34497] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-07-13 07:16:59,185 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.HMaster$2(1952): Client=jenkins//148.251.75.209 merge regions bb6a1de6c33e9b4d0a93922c18bdc355, a9e99b22a8a7456b79dc7b2070c918b3 2023-07-13 07:16:59,193 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[bb6a1de6c33e9b4d0a93922c18bdc355, a9e99b22a8a7456b79dc7b2070c918b3], force=true 2023-07-13 07:16:59,195 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[bb6a1de6c33e9b4d0a93922c18bdc355, a9e99b22a8a7456b79dc7b2070c918b3], force=true 2023-07-13 07:16:59,195 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[bb6a1de6c33e9b4d0a93922c18bdc355, a9e99b22a8a7456b79dc7b2070c918b3], force=true 2023-07-13 07:16:59,195 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[bb6a1de6c33e9b4d0a93922c18bdc355, a9e99b22a8a7456b79dc7b2070c918b3], force=true 2023-07-13 07:16:59,198 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-13 07:16:59,220 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=bb6a1de6c33e9b4d0a93922c18bdc355, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a9e99b22a8a7456b79dc7b2070c918b3, UNASSIGN}] 2023-07-13 07:16:59,223 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=bb6a1de6c33e9b4d0a93922c18bdc355, UNASSIGN 2023-07-13 07:16:59,223 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a9e99b22a8a7456b79dc7b2070c918b3, UNASSIGN 2023-07-13 07:16:59,224 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=a9e99b22a8a7456b79dc7b2070c918b3, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:16:59,224 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=bb6a1de6c33e9b4d0a93922c18bdc355, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:16:59,224 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689232618550.a9e99b22a8a7456b79dc7b2070c918b3.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689232619224"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689232619224"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689232619224"}]},"ts":"1689232619224"} 2023-07-13 07:16:59,224 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689232618550.bb6a1de6c33e9b4d0a93922c18bdc355.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689232619224"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689232619224"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689232619224"}]},"ts":"1689232619224"} 2023-07-13 07:16:59,226 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=74, ppid=73, state=RUNNABLE; CloseRegionProcedure a9e99b22a8a7456b79dc7b2070c918b3, server=jenkins-hbase20.apache.org,44607,1689232541504}] 2023-07-13 07:16:59,227 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=75, ppid=72, state=RUNNABLE; CloseRegionProcedure bb6a1de6c33e9b4d0a93922c18bdc355, server=jenkins-hbase20.apache.org,42807,1689232541407}] 2023-07-13 07:16:59,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-13 07:16:59,380 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close bb6a1de6c33e9b4d0a93922c18bdc355 2023-07-13 07:16:59,380 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close a9e99b22a8a7456b79dc7b2070c918b3 2023-07-13 07:16:59,381 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing bb6a1de6c33e9b4d0a93922c18bdc355, disabling compactions & flushes 2023-07-13 07:16:59,381 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689232618550.bb6a1de6c33e9b4d0a93922c18bdc355. 2023-07-13 07:16:59,383 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing a9e99b22a8a7456b79dc7b2070c918b3, disabling compactions & flushes 2023-07-13 07:16:59,383 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689232618550.bb6a1de6c33e9b4d0a93922c18bdc355. 2023-07-13 07:16:59,383 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689232618550.a9e99b22a8a7456b79dc7b2070c918b3. 2023-07-13 07:16:59,383 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689232618550.bb6a1de6c33e9b4d0a93922c18bdc355. after waiting 0 ms 2023-07-13 07:16:59,383 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689232618550.a9e99b22a8a7456b79dc7b2070c918b3. 2023-07-13 07:16:59,383 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689232618550.bb6a1de6c33e9b4d0a93922c18bdc355. 2023-07-13 07:16:59,383 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689232618550.a9e99b22a8a7456b79dc7b2070c918b3. after waiting 0 ms 2023-07-13 07:16:59,383 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689232618550.a9e99b22a8a7456b79dc7b2070c918b3. 2023-07-13 07:16:59,383 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing bb6a1de6c33e9b4d0a93922c18bdc355 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-13 07:16:59,383 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing a9e99b22a8a7456b79dc7b2070c918b3 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-13 07:16:59,395 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a9e99b22a8a7456b79dc7b2070c918b3/.tmp/cf/5f40aa4810744acf97b03a07f0c65f90 2023-07-13 07:16:59,402 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bb6a1de6c33e9b4d0a93922c18bdc355/.tmp/cf/01945552bb494b28b3caa0e8f13d3226 2023-07-13 07:16:59,403 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a9e99b22a8a7456b79dc7b2070c918b3/.tmp/cf/5f40aa4810744acf97b03a07f0c65f90 as hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a9e99b22a8a7456b79dc7b2070c918b3/cf/5f40aa4810744acf97b03a07f0c65f90 2023-07-13 07:16:59,408 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a9e99b22a8a7456b79dc7b2070c918b3/cf/5f40aa4810744acf97b03a07f0c65f90, entries=1, sequenceid=5, filesize=4.7 K 2023-07-13 07:16:59,408 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bb6a1de6c33e9b4d0a93922c18bdc355/.tmp/cf/01945552bb494b28b3caa0e8f13d3226 as hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bb6a1de6c33e9b4d0a93922c18bdc355/cf/01945552bb494b28b3caa0e8f13d3226 2023-07-13 07:16:59,409 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for a9e99b22a8a7456b79dc7b2070c918b3 in 26ms, sequenceid=5, compaction requested=false 2023-07-13 07:16:59,409 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-07-13 07:16:59,419 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bb6a1de6c33e9b4d0a93922c18bdc355/cf/01945552bb494b28b3caa0e8f13d3226, entries=1, sequenceid=5, filesize=4.7 K 2023-07-13 07:16:59,420 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for bb6a1de6c33e9b4d0a93922c18bdc355 in 37ms, sequenceid=5, compaction requested=false 2023-07-13 07:16:59,422 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a9e99b22a8a7456b79dc7b2070c918b3/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-13 07:16:59,428 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-13 07:16:59,428 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689232618550.a9e99b22a8a7456b79dc7b2070c918b3. 2023-07-13 07:16:59,428 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for a9e99b22a8a7456b79dc7b2070c918b3: 2023-07-13 07:16:59,430 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed a9e99b22a8a7456b79dc7b2070c918b3 2023-07-13 07:16:59,430 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=a9e99b22a8a7456b79dc7b2070c918b3, regionState=CLOSED 2023-07-13 07:16:59,430 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689232618550.a9e99b22a8a7456b79dc7b2070c918b3.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689232619430"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689232619430"}]},"ts":"1689232619430"} 2023-07-13 07:16:59,434 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bb6a1de6c33e9b4d0a93922c18bdc355/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-13 07:16:59,434 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=74, resume processing ppid=73 2023-07-13 07:16:59,434 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=74, ppid=73, state=SUCCESS; CloseRegionProcedure a9e99b22a8a7456b79dc7b2070c918b3, server=jenkins-hbase20.apache.org,44607,1689232541504 in 206 msec 2023-07-13 07:16:59,434 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-13 07:16:59,434 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689232618550.bb6a1de6c33e9b4d0a93922c18bdc355. 2023-07-13 07:16:59,434 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for bb6a1de6c33e9b4d0a93922c18bdc355: 2023-07-13 07:16:59,435 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a9e99b22a8a7456b79dc7b2070c918b3, UNASSIGN in 214 msec 2023-07-13 07:16:59,436 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed bb6a1de6c33e9b4d0a93922c18bdc355 2023-07-13 07:16:59,436 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=bb6a1de6c33e9b4d0a93922c18bdc355, regionState=CLOSED 2023-07-13 07:16:59,436 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689232618550.bb6a1de6c33e9b4d0a93922c18bdc355.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689232619436"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689232619436"}]},"ts":"1689232619436"} 2023-07-13 07:16:59,445 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=75, resume processing ppid=72 2023-07-13 07:16:59,445 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=75, ppid=72, state=SUCCESS; CloseRegionProcedure bb6a1de6c33e9b4d0a93922c18bdc355, server=jenkins-hbase20.apache.org,42807,1689232541407 in 216 msec 2023-07-13 07:16:59,449 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=72, resume processing ppid=71 2023-07-13 07:16:59,450 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=bb6a1de6c33e9b4d0a93922c18bdc355, UNASSIGN in 229 msec 2023-07-13 07:16:59,502 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-13 07:16:59,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-13 07:16:59,939 DEBUG [PEWorker-4] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4beb1a44606706f043c2fcaf846e9362/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-07-13 07:16:59,941 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689232618550.bb6a1de6c33e9b4d0a93922c18bdc355.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-13 07:16:59,942 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689232618550.a9e99b22a8a7456b79dc7b2070c918b3.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-13 07:16:59,942 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689232618551.4beb1a44606706f043c2fcaf846e9362.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-13 07:17:00,002 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4beb1a44606706f043c2fcaf846e9362, ASSIGN}] 2023-07-13 07:17:00,003 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4beb1a44606706f043c2fcaf846e9362, ASSIGN 2023-07-13 07:17:00,004 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4beb1a44606706f043c2fcaf846e9362, ASSIGN; state=MERGED, location=jenkins-hbase20.apache.org,42807,1689232541407; forceNewPlan=false, retain=false 2023-07-13 07:17:00,154 INFO [jenkins-hbase20:37475] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-13 07:17:00,156 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=4beb1a44606706f043c2fcaf846e9362, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:17:00,157 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689232618551.4beb1a44606706f043c2fcaf846e9362.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689232620156"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689232620156"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689232620156"}]},"ts":"1689232620156"} 2023-07-13 07:17:00,159 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure 4beb1a44606706f043c2fcaf846e9362, server=jenkins-hbase20.apache.org,42807,1689232541407}] 2023-07-13 07:17:00,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-13 07:17:00,314 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689232618551.4beb1a44606706f043c2fcaf846e9362. 2023-07-13 07:17:00,315 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4beb1a44606706f043c2fcaf846e9362, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689232618551.4beb1a44606706f043c2fcaf846e9362.', STARTKEY => '', ENDKEY => ''} 2023-07-13 07:17:00,315 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689232618551.4beb1a44606706f043c2fcaf846e9362. service=AccessControlService 2023-07-13 07:17:00,315 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-13 07:17:00,315 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 4beb1a44606706f043c2fcaf846e9362 2023-07-13 07:17:00,315 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689232618551.4beb1a44606706f043c2fcaf846e9362.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 07:17:00,315 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 4beb1a44606706f043c2fcaf846e9362 2023-07-13 07:17:00,315 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 4beb1a44606706f043c2fcaf846e9362 2023-07-13 07:17:00,316 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4beb1a44606706f043c2fcaf846e9362/.regioninfo 2023-07-13 07:17:00,350 INFO [StoreOpener-4beb1a44606706f043c2fcaf846e9362-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 4beb1a44606706f043c2fcaf846e9362 2023-07-13 07:17:00,351 DEBUG [StoreOpener-4beb1a44606706f043c2fcaf846e9362-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4beb1a44606706f043c2fcaf846e9362/cf 2023-07-13 07:17:00,351 DEBUG [StoreOpener-4beb1a44606706f043c2fcaf846e9362-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4beb1a44606706f043c2fcaf846e9362/cf 2023-07-13 07:17:00,352 INFO [StoreOpener-4beb1a44606706f043c2fcaf846e9362-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4beb1a44606706f043c2fcaf846e9362 columnFamilyName cf 2023-07-13 07:17:00,393 DEBUG [StoreOpener-4beb1a44606706f043c2fcaf846e9362-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4beb1a44606706f043c2fcaf846e9362/cf/01945552bb494b28b3caa0e8f13d3226.bb6a1de6c33e9b4d0a93922c18bdc355->hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bb6a1de6c33e9b4d0a93922c18bdc355/cf/01945552bb494b28b3caa0e8f13d3226-top 2023-07-13 07:17:00,401 DEBUG [StoreOpener-4beb1a44606706f043c2fcaf846e9362-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4beb1a44606706f043c2fcaf846e9362/cf/5f40aa4810744acf97b03a07f0c65f90.a9e99b22a8a7456b79dc7b2070c918b3->hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a9e99b22a8a7456b79dc7b2070c918b3/cf/5f40aa4810744acf97b03a07f0c65f90-top 2023-07-13 07:17:00,402 INFO [StoreOpener-4beb1a44606706f043c2fcaf846e9362-1] regionserver.HStore(310): Store=4beb1a44606706f043c2fcaf846e9362/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-13 07:17:00,403 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4beb1a44606706f043c2fcaf846e9362 2023-07-13 07:17:00,405 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4beb1a44606706f043c2fcaf846e9362 2023-07-13 07:17:00,413 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 4beb1a44606706f043c2fcaf846e9362 2023-07-13 07:17:00,415 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 4beb1a44606706f043c2fcaf846e9362; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66119109, jitterRate=-0.014748498797416687}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-13 07:17:00,415 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 4beb1a44606706f043c2fcaf846e9362: 2023-07-13 07:17:00,416 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689232618551.4beb1a44606706f043c2fcaf846e9362., pid=77, masterSystemTime=1689232620311 2023-07-13 07:17:00,416 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1689232618551.4beb1a44606706f043c2fcaf846e9362.,because compaction is disabled. 2023-07-13 07:17:00,418 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689232618551.4beb1a44606706f043c2fcaf846e9362. 2023-07-13 07:17:00,418 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689232618551.4beb1a44606706f043c2fcaf846e9362. 2023-07-13 07:17:00,418 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=4beb1a44606706f043c2fcaf846e9362, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:17:00,419 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689232618551.4beb1a44606706f043c2fcaf846e9362.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689232620418"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689232620418"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689232620418"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689232620418"}]},"ts":"1689232620418"} 2023-07-13 07:17:00,429 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-07-13 07:17:00,429 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure 4beb1a44606706f043c2fcaf846e9362, server=jenkins-hbase20.apache.org,42807,1689232541407 in 263 msec 2023-07-13 07:17:00,430 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=71 2023-07-13 07:17:00,430 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4beb1a44606706f043c2fcaf846e9362, ASSIGN in 427 msec 2023-07-13 07:17:00,434 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[bb6a1de6c33e9b4d0a93922c18bdc355, a9e99b22a8a7456b79dc7b2070c918b3], force=true in 1.2420 sec 2023-07-13 07:17:00,907 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689232548306_0004_000001 (auth:SIMPLE) 2023-07-13 07:17:01,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-13 07:17:01,309 INFO [Listener at jenkins-hbase20.apache.org/34497] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-07-13 07:17:01,310 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-13 07:17:01,310 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689232621310 (current time:1689232621310). 2023-07-13 07:17:01,310 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-13 07:17:01,310 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] zookeeper.ReadOnlyZKClient(139): Connect 0x5cbf26fc to 127.0.0.1:58099 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-13 07:17:01,318 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2f5c991, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-13 07:17:01,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 07:17:01,323 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:50572, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 07:17:01,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5cbf26fc to 127.0.0.1:58099 2023-07-13 07:17:01,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 07:17:01,325 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] zookeeper.ReadOnlyZKClient(139): Connect 0x27192b36 to 127.0.0.1:58099 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-13 07:17:01,331 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2b471ef, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-13 07:17:01,332 DEBUG [hconnection-0x2ea19969-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 07:17:01,337 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:50588, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 07:17:01,343 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 07:17:01,347 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:44760, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 07:17:01,349 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x27192b36 to 127.0.0.1:58099 2023-07-13 07:17:01,349 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 07:17:01,349 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-13 07:17:01,350 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-13 07:17:01,350 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-13 07:17:01,354 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-13 07:17:01,357 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-13 07:17:01,358 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1689233221358 2023-07-13 07:17:01,358 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:17:01,358 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-13 07:17:01,364 DEBUG [Listener at jenkins-hbase20.apache.org/34497] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-13 07:17:01,365 DEBUG [Listener at jenkins-hbase20.apache.org/34497] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-13 07:17:01,365 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-13 07:17:01,369 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-13 07:17:01,371 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 16 msec 2023-07-13 07:17:01,373 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-13 07:17:01,374 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1689233221374 2023-07-13 07:17:01,391 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:17:01,391 INFO [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-07-13 07:17:01,391 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 07:17:01,393 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-07-13 07:17:01,393 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-07-13 07:17:01,393 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:17:01,393 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:17:01,394 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:17:01,394 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:17:01,394 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:17:01,394 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:17:01,394 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:17:01,394 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:17:01,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:17:01,394 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:17:01,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:17:01,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:17:01,395 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:17:01,395 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-13 07:17:01,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:17:01,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:17:01,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:17:01,395 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:17:01,395 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:17:01,395 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:17:01,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-13 07:17:01,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-13 07:17:01,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:17:01,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-13 07:17:01,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:17:01,395 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-13 07:17:01,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:17:01,396 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-13 07:17:01,396 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-13 07:17:01,396 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:17:01,396 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:17:01,396 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-13 07:17:01,396 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-13 07:17:01,396 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 07:17:01,396 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 07:17:01,398 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:17:01,400 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-13 07:17:01,400 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-13 07:17:01,400 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 07:17:01,400 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-13 07:17:01,401 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-13 07:17:01,401 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-13 07:17:01,401 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-13 07:17:01,401 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44195,1689232541463' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-13 07:17:01,400 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-13 07:17:01,401 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,42807,1689232541407' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-13 07:17:01,401 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44607,1689232541504' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-13 07:17:01,408 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:17:01,409 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:17:01,409 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:17:01,409 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 07:17:01,409 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:17:01,409 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:17:01,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:17:01,409 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:17:01,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 07:17:01,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 07:17:01,409 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 07:17:01,409 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:17:01,409 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 07:17:01,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 07:17:01,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 07:17:01,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:17:01,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:17:01,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:17:01,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:17:01,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 07:17:01,411 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,42807,1689232541407' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-07-13 07:17:01,411 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@495bd07c[Count = 0] remaining members to acquire global barrier 2023-07-13 07:17:01,411 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-07-13 07:17:01,411 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:17:01,411 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:17:01,411 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:17:01,412 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:17:01,411 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:17:01,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:17:01,412 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:17:01,412 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:17:01,412 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-13 07:17:01,412 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-13 07:17:01,412 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:17:01,412 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-13 07:17:01,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:17:01,412 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase20.apache.org,44607,1689232541504' in zk 2023-07-13 07:17:01,412 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-13 07:17:01,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:17:01,412 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-13 07:17:01,412 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-13 07:17:01,412 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase20.apache.org,44195,1689232541463' in zk 2023-07-13 07:17:01,412 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-13 07:17:01,412 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-13 07:17:01,412 DEBUG [rs(jenkins-hbase20.apache.org,42807,1689232541407)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689232618551.4beb1a44606706f043c2fcaf846e9362. 2023-07-13 07:17:01,412 DEBUG [rs(jenkins-hbase20.apache.org,42807,1689232541407)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689232618551.4beb1a44606706f043c2fcaf846e9362. started... 2023-07-13 07:17:01,414 DEBUG [rs(jenkins-hbase20.apache.org,42807,1689232541407)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4beb1a44606706f043c2fcaf846e9362: 2023-07-13 07:17:01,414 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-13 07:17:01,414 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 07:17:01,414 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-13 07:17:01,415 DEBUG [rs(jenkins-hbase20.apache.org,42807,1689232541407)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689232618551.4beb1a44606706f043c2fcaf846e9362.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:17:01,415 DEBUG [rs(jenkins-hbase20.apache.org,42807,1689232541407)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-13 07:17:01,416 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-13 07:17:01,416 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 07:17:01,416 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-13 07:17:01,419 DEBUG [rs(jenkins-hbase20.apache.org,42807,1689232541407)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4beb1a44606706f043c2fcaf846e9362/cf/01945552bb494b28b3caa0e8f13d3226.bb6a1de6c33e9b4d0a93922c18bdc355->hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bb6a1de6c33e9b4d0a93922c18bdc355/cf/01945552bb494b28b3caa0e8f13d3226-top, hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4beb1a44606706f043c2fcaf846e9362/cf/5f40aa4810744acf97b03a07f0c65f90.a9e99b22a8a7456b79dc7b2070c918b3->hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a9e99b22a8a7456b79dc7b2070c918b3/cf/5f40aa4810744acf97b03a07f0c65f90-top] hfiles 2023-07-13 07:17:01,419 DEBUG [rs(jenkins-hbase20.apache.org,42807,1689232541407)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4beb1a44606706f043c2fcaf846e9362/cf/01945552bb494b28b3caa0e8f13d3226.bb6a1de6c33e9b4d0a93922c18bdc355 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:17:01,420 DEBUG [rs(jenkins-hbase20.apache.org,42807,1689232541407)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4beb1a44606706f043c2fcaf846e9362/cf/5f40aa4810744acf97b03a07f0c65f90.a9e99b22a8a7456b79dc7b2070c918b3 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:17:01,430 DEBUG [rs(jenkins-hbase20.apache.org,42807,1689232541407)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689232618551.4beb1a44606706f043c2fcaf846e9362. completed. 2023-07-13 07:17:01,431 DEBUG [rs(jenkins-hbase20.apache.org,42807,1689232541407)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689232618551.4beb1a44606706f043c2fcaf846e9362. 2023-07-13 07:17:01,431 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-13 07:17:01,431 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-13 07:17:01,431 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:17:01,431 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-13 07:17:01,431 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase20.apache.org,42807,1689232541407' in zk 2023-07-13 07:17:01,433 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-13 07:17:01,433 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:17:01,433 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 07:17:01,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:17:01,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 07:17:01,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 07:17:01,433 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-13 07:17:01,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 07:17:01,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 07:17:01,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:17:01,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:17:01,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:17:01,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:17:01,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 07:17:01,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:17:01,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:17:01,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:17:01,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:17:01,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase20.apache.org,42807,1689232541407': 2023-07-13 07:17:01,436 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,42807,1689232541407' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-07-13 07:17:01,436 INFO [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-07-13 07:17:01,436 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-13 07:17:01,436 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-13 07:17:01,436 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:17:01,436 INFO [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-13 07:17:01,437 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:17:01,437 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:17:01,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:17:01,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 07:17:01,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 07:17:01,437 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:17:01,437 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:17:01,437 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:17:01,437 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:17:01,438 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:17:01,438 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:17:01,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:17:01,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 07:17:01,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:17:01,438 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:17:01,438 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:17:01,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:17:01,438 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:17:01,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:17:01,438 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:17:01,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:17:01,438 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:17:01,438 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:17:01,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:17:01,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:17:01,438 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:17:01,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 07:17:01,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:17:01,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:17:01,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:17:01,439 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:17:01,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:17:01,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:17:01,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:17:01,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:17:01,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 07:17:01,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:17:01,440 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:17:01,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:17:01,440 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:17:01,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:17:01,440 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:17:01,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:17:01,442 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:17:01,442 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:17:01,442 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:17:01,442 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:17:01,442 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:17:01,442 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:17:01,442 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:17:01,442 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:17:01,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:17:01,442 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:17:01,442 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 07:17:01,442 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:17:01,443 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:17:01,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:17:01,443 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:17:01,443 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:17:01,443 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:17:01,443 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:17:01,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:17:01,443 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:17:01,443 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:17:01,443 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:17:01,443 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:17:01,443 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:17:01,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:17:01,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:17:01,443 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:17:01,443 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:17:01,443 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:17:01,443 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:17:01,444 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:17:01,444 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:17:01,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:17:01,464 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:17:01,465 DEBUG [Listener at jenkins-hbase20.apache.org/34497] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 07:17:01,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-13 07:17:01,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-13 07:17:01,466 DEBUG [Listener at jenkins-hbase20.apache.org/34497] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-13 07:17:01,491 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-07-13 07:17:01,491 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:17:01,491 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:17:01,492 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1689232621358Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689232621443 (+85 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689232621443Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689232621447 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689232621457 (+10 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1689232621491 (+34 ms) 2023-07-13 07:17:01,494 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-13 07:17:01,496 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 131 msec 2023-07-13 07:17:01,666 DEBUG [Listener at jenkins-hbase20.apache.org/34497] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 07:17:01,667 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-13 07:17:01,667 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-13 07:17:01,667 INFO [Listener at jenkins-hbase20.apache.org/34497] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/export-test/export-1689232621667 2023-07-13 07:17:01,667 INFO [Listener at jenkins-hbase20.apache.org/34497] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost.localdomain:40681, tgtDir=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/export-test/export-1689232621667, rawTgtDir=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/export-test/export-1689232621667, srcFsUri=hdfs://localhost.localdomain:40681, srcDir=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e 2023-07-13 07:17:01,687 DEBUG [Listener at jenkins-hbase20.apache.org/34497] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost.localdomain:40681, inputRoot=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e 2023-07-13 07:17:01,688 DEBUG [Listener at jenkins-hbase20.apache.org/34497] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-299669798_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/export-test/export-1689232621667, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/export-test/export-1689232621667/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:17:01,688 INFO [Listener at jenkins-hbase20.apache.org/34497] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost.localdomain:40681, inputRoot=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e, snapshotDir=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-07-13 07:17:01,697 INFO [Listener at jenkins-hbase20.apache.org/34497] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/export-test/export-1689232621667/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:17:01,726 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-13 07:17:01,726 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-13 07:17:01,727 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-13 07:17:01,727 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-13 07:17:01,727 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-13 07:17:01,728 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-13 07:17:01,728 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-13 07:17:01,796 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a827846-4542-2630-0c34-c6bc20d13d68/hadoop-5386885722349284209.jar 2023-07-13 07:17:01,797 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-13 07:17:01,797 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-13 07:17:01,797 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-13 07:17:01,797 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-13 07:17:01,798 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-13 07:17:01,798 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-13 07:17:01,798 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-13 07:17:01,799 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-13 07:17:01,799 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-13 07:17:01,799 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-13 07:17:01,800 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-13 07:17:01,800 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-13 07:17:01,800 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-13 07:17:01,800 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-13 07:17:01,801 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-13 07:17:01,801 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-13 07:17:01,801 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-13 07:17:01,802 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-13 07:17:01,802 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-13 07:17:01,802 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-13 07:17:01,802 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-13 07:17:01,803 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-13 07:17:01,803 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-13 07:17:02,328 WARN [Listener at jenkins-hbase20.apache.org/34497] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-13 07:17:02,331 INFO [Listener at jenkins-hbase20.apache.org/34497] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-07-13 07:17:02,333 DEBUG [Listener at jenkins-hbase20.apache.org/34497] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-07-13 07:17:02,414 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-13 07:17:02,414 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-13 07:17:02,472 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-13 07:17:02,648 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689232548306_0005_000001 (auth:SIMPLE) 2023-07-13 07:17:06,731 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689232548306_0005_000001 (auth:SIMPLE) 2023-07-13 07:17:08,976 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689232548306_0005_000001 (auth:SIMPLE) 2023-07-13 07:17:12,990 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689232548306_0005_000001 (auth:SIMPLE) 2023-07-13 07:17:14,555 INFO [Listener at jenkins-hbase20.apache.org/34497] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-13 07:17:14,556 INFO [Listener at jenkins-hbase20.apache.org/34497] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-13 07:17:14,565 INFO [Listener at jenkins-hbase20.apache.org/34497] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:17:14,565 INFO [Listener at jenkins-hbase20.apache.org/34497] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-13 07:17:14,566 INFO [Listener at jenkins-hbase20.apache.org/34497] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-13 07:17:14,566 DEBUG [Listener at jenkins-hbase20.apache.org/34497] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_139625932_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:17:14,567 DEBUG [Listener at jenkins-hbase20.apache.org/34497] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-13 07:17:14,567 DEBUG [Listener at jenkins-hbase20.apache.org/34497] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-13 07:17:14,567 DEBUG [Listener at jenkins-hbase20.apache.org/34497] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_139625932_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/export-test/export-1689232621667/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/export-test/export-1689232621667/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:17:14,568 DEBUG [Listener at jenkins-hbase20.apache.org/34497] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/export-test/export-1689232621667/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-13 07:17:14,568 DEBUG [Listener at jenkins-hbase20.apache.org/34497] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/export-test/export-1689232621667/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-13 07:17:14,576 INFO [Listener at jenkins-hbase20.apache.org/34497] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:17:14,576 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:17:14,577 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] procedure2.ProcedureExecutor(1029): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:17:14,581 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689232634581"}]},"ts":"1689232634581"} 2023-07-13 07:17:14,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-13 07:17:14,583 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-07-13 07:17:14,584 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-07-13 07:17:14,585 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4beb1a44606706f043c2fcaf846e9362, UNASSIGN}] 2023-07-13 07:17:14,587 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4beb1a44606706f043c2fcaf846e9362, UNASSIGN 2023-07-13 07:17:14,589 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=4beb1a44606706f043c2fcaf846e9362, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:17:14,589 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689232618551.4beb1a44606706f043c2fcaf846e9362.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689232634589"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689232634589"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689232634589"}]},"ts":"1689232634589"} 2023-07-13 07:17:14,591 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure 4beb1a44606706f043c2fcaf846e9362, server=jenkins-hbase20.apache.org,42807,1689232541407}] 2023-07-13 07:17:14,683 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-13 07:17:14,743 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 4beb1a44606706f043c2fcaf846e9362 2023-07-13 07:17:14,743 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 4beb1a44606706f043c2fcaf846e9362, disabling compactions & flushes 2023-07-13 07:17:14,743 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689232618551.4beb1a44606706f043c2fcaf846e9362. 2023-07-13 07:17:14,744 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689232618551.4beb1a44606706f043c2fcaf846e9362. 2023-07-13 07:17:14,744 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689232618551.4beb1a44606706f043c2fcaf846e9362. after waiting 0 ms 2023-07-13 07:17:14,744 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689232618551.4beb1a44606706f043c2fcaf846e9362. 2023-07-13 07:17:14,761 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4beb1a44606706f043c2fcaf846e9362/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-07-13 07:17:14,761 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-13 07:17:14,763 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689232618551.4beb1a44606706f043c2fcaf846e9362. 2023-07-13 07:17:14,763 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 4beb1a44606706f043c2fcaf846e9362: 2023-07-13 07:17:14,765 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 4beb1a44606706f043c2fcaf846e9362 2023-07-13 07:17:14,766 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=4beb1a44606706f043c2fcaf846e9362, regionState=CLOSED 2023-07-13 07:17:14,766 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689232618551.4beb1a44606706f043c2fcaf846e9362.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689232634766"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689232634766"}]},"ts":"1689232634766"} 2023-07-13 07:17:14,777 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=82, resume processing ppid=81 2023-07-13 07:17:14,777 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure 4beb1a44606706f043c2fcaf846e9362, server=jenkins-hbase20.apache.org,42807,1689232541407 in 177 msec 2023-07-13 07:17:14,780 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=80 2023-07-13 07:17:14,780 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4beb1a44606706f043c2fcaf846e9362, UNASSIGN in 193 msec 2023-07-13 07:17:14,781 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689232634781"}]},"ts":"1689232634781"} 2023-07-13 07:17:14,782 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-07-13 07:17:14,783 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-07-13 07:17:14,787 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 209 msec 2023-07-13 07:17:14,886 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-13 07:17:14,887 INFO [Listener at jenkins-hbase20.apache.org/34497] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-07-13 07:17:14,888 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.HMaster$5(2228): Client=jenkins//148.251.75.209 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:17:14,889 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] procedure2.ProcedureExecutor(1029): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:17:14,897 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:17:14,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:17:14,898 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:17:14,899 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44607] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:17:14,901 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:17:14,901 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:17:14,902 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:17:14,901 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:17:14,902 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-13 07:17:14,902 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-13 07:17:14,902 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-13 07:17:14,903 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:17:14,903 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:17:14,903 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 07:17:14,903 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 07:17:14,903 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 07:17:14,903 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:17:14,904 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 07:17:14,904 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-13 07:17:14,904 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-13 07:17:14,905 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-13 07:17:14,906 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-07-13 07:17:14,907 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-13 07:17:14,907 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-13 07:17:14,907 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-13 07:17:14,915 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4beb1a44606706f043c2fcaf846e9362 2023-07-13 07:17:14,918 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4beb1a44606706f043c2fcaf846e9362/cf, FileablePath, hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4beb1a44606706f043c2fcaf846e9362/recovered.edits] 2023-07-13 07:17:14,922 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a9e99b22a8a7456b79dc7b2070c918b3 2023-07-13 07:17:14,922 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bb6a1de6c33e9b4d0a93922c18bdc355 2023-07-13 07:17:14,927 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a9e99b22a8a7456b79dc7b2070c918b3/cf, FileablePath, hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a9e99b22a8a7456b79dc7b2070c918b3/recovered.edits] 2023-07-13 07:17:14,938 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bb6a1de6c33e9b4d0a93922c18bdc355/cf, FileablePath, hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bb6a1de6c33e9b4d0a93922c18bdc355/recovered.edits] 2023-07-13 07:17:14,943 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a9e99b22a8a7456b79dc7b2070c918b3/cf/5f40aa4810744acf97b03a07f0c65f90 to hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a9e99b22a8a7456b79dc7b2070c918b3/cf/5f40aa4810744acf97b03a07f0c65f90 2023-07-13 07:17:14,946 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4beb1a44606706f043c2fcaf846e9362/cf/01945552bb494b28b3caa0e8f13d3226.bb6a1de6c33e9b4d0a93922c18bdc355 to hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4beb1a44606706f043c2fcaf846e9362/cf/01945552bb494b28b3caa0e8f13d3226.bb6a1de6c33e9b4d0a93922c18bdc355 2023-07-13 07:17:14,947 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a9e99b22a8a7456b79dc7b2070c918b3/recovered.edits/8.seqid to hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a9e99b22a8a7456b79dc7b2070c918b3/recovered.edits/8.seqid 2023-07-13 07:17:14,948 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a9e99b22a8a7456b79dc7b2070c918b3 2023-07-13 07:17:14,950 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4beb1a44606706f043c2fcaf846e9362/cf/5f40aa4810744acf97b03a07f0c65f90.a9e99b22a8a7456b79dc7b2070c918b3 to hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4beb1a44606706f043c2fcaf846e9362/cf/5f40aa4810744acf97b03a07f0c65f90.a9e99b22a8a7456b79dc7b2070c918b3 2023-07-13 07:17:14,952 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4beb1a44606706f043c2fcaf846e9362/recovered.edits/12.seqid to hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4beb1a44606706f043c2fcaf846e9362/recovered.edits/12.seqid 2023-07-13 07:17:14,953 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4beb1a44606706f043c2fcaf846e9362 2023-07-13 07:17:14,955 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bb6a1de6c33e9b4d0a93922c18bdc355/cf/01945552bb494b28b3caa0e8f13d3226 to hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bb6a1de6c33e9b4d0a93922c18bdc355/cf/01945552bb494b28b3caa0e8f13d3226 2023-07-13 07:17:14,959 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bb6a1de6c33e9b4d0a93922c18bdc355/recovered.edits/8.seqid to hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bb6a1de6c33e9b4d0a93922c18bdc355/recovered.edits/8.seqid 2023-07-13 07:17:14,960 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bb6a1de6c33e9b4d0a93922c18bdc355 2023-07-13 07:17:14,960 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-13 07:17:14,963 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:17:14,974 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-07-13 07:17:14,981 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-07-13 07:17:14,982 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:17:14,982 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-07-13 07:17:14,982 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689232618551.4beb1a44606706f043c2fcaf846e9362.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689232634982"}]},"ts":"9223372036854775807"} 2023-07-13 07:17:14,995 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-07-13 07:17:14,996 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 4beb1a44606706f043c2fcaf846e9362, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689232618551.4beb1a44606706f043c2fcaf846e9362.', STARTKEY => '', ENDKEY => ''}] 2023-07-13 07:17:14,996 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-07-13 07:17:14,996 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689232634996"}]},"ts":"9223372036854775807"} 2023-07-13 07:17:15,001 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-07-13 07:17:15,003 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:17:15,007 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 116 msec 2023-07-13 07:17:15,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-13 07:17:15,011 INFO [Listener at jenkins-hbase20.apache.org/34497] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-07-13 07:17:15,012 INFO [Listener at jenkins-hbase20.apache.org/34497] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-07-13 07:17:15,013 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testtb-testExportFileSystemStateWithMergeRegion 2023-07-13 07:17:15,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] procedure2.ProcedureExecutor(1029): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-13 07:17:15,019 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-13 07:17:15,019 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689232635019"}]},"ts":"1689232635019"} 2023-07-13 07:17:15,021 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-07-13 07:17:15,022 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-07-13 07:17:15,023 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=1b4802ed4d3dee1e2a4da4cb99644369, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=02e1f115dcd2a0d93b9d3bac5716fcc5, UNASSIGN}] 2023-07-13 07:17:15,027 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=1b4802ed4d3dee1e2a4da4cb99644369, UNASSIGN 2023-07-13 07:17:15,027 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=02e1f115dcd2a0d93b9d3bac5716fcc5, UNASSIGN 2023-07-13 07:17:15,029 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=1b4802ed4d3dee1e2a4da4cb99644369, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:17:15,030 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=02e1f115dcd2a0d93b9d3bac5716fcc5, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:17:15,030 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689232617134.02e1f115dcd2a0d93b9d3bac5716fcc5.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689232635029"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689232635029"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689232635029"}]},"ts":"1689232635029"} 2023-07-13 07:17:15,030 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689232617134.1b4802ed4d3dee1e2a4da4cb99644369.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689232635029"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689232635029"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689232635029"}]},"ts":"1689232635029"} 2023-07-13 07:17:15,032 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=87, ppid=86, state=RUNNABLE; CloseRegionProcedure 02e1f115dcd2a0d93b9d3bac5716fcc5, server=jenkins-hbase20.apache.org,42807,1689232541407}] 2023-07-13 07:17:15,033 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=88, ppid=85, state=RUNNABLE; CloseRegionProcedure 1b4802ed4d3dee1e2a4da4cb99644369, server=jenkins-hbase20.apache.org,44195,1689232541463}] 2023-07-13 07:17:15,120 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-13 07:17:15,185 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 02e1f115dcd2a0d93b9d3bac5716fcc5 2023-07-13 07:17:15,185 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 02e1f115dcd2a0d93b9d3bac5716fcc5, disabling compactions & flushes 2023-07-13 07:17:15,185 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689232617134.02e1f115dcd2a0d93b9d3bac5716fcc5. 2023-07-13 07:17:15,185 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689232617134.02e1f115dcd2a0d93b9d3bac5716fcc5. 2023-07-13 07:17:15,185 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689232617134.02e1f115dcd2a0d93b9d3bac5716fcc5. after waiting 0 ms 2023-07-13 07:17:15,186 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689232617134.02e1f115dcd2a0d93b9d3bac5716fcc5. 2023-07-13 07:17:15,186 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 1b4802ed4d3dee1e2a4da4cb99644369 2023-07-13 07:17:15,186 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 1b4802ed4d3dee1e2a4da4cb99644369, disabling compactions & flushes 2023-07-13 07:17:15,187 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689232617134.1b4802ed4d3dee1e2a4da4cb99644369. 2023-07-13 07:17:15,187 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689232617134.1b4802ed4d3dee1e2a4da4cb99644369. 2023-07-13 07:17:15,187 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689232617134.1b4802ed4d3dee1e2a4da4cb99644369. after waiting 0 ms 2023-07-13 07:17:15,187 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689232617134.1b4802ed4d3dee1e2a4da4cb99644369. 2023-07-13 07:17:15,205 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testExportFileSystemStateWithMergeRegion/1b4802ed4d3dee1e2a4da4cb99644369/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-13 07:17:15,205 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-13 07:17:15,207 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689232617134.1b4802ed4d3dee1e2a4da4cb99644369. 2023-07-13 07:17:15,207 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 1b4802ed4d3dee1e2a4da4cb99644369: 2023-07-13 07:17:15,209 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testExportFileSystemStateWithMergeRegion/02e1f115dcd2a0d93b9d3bac5716fcc5/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-13 07:17:15,209 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 1b4802ed4d3dee1e2a4da4cb99644369 2023-07-13 07:17:15,209 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-13 07:17:15,210 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=1b4802ed4d3dee1e2a4da4cb99644369, regionState=CLOSED 2023-07-13 07:17:15,210 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689232617134.1b4802ed4d3dee1e2a4da4cb99644369.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689232635210"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689232635210"}]},"ts":"1689232635210"} 2023-07-13 07:17:15,212 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689232617134.02e1f115dcd2a0d93b9d3bac5716fcc5. 2023-07-13 07:17:15,212 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 02e1f115dcd2a0d93b9d3bac5716fcc5: 2023-07-13 07:17:15,214 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 02e1f115dcd2a0d93b9d3bac5716fcc5 2023-07-13 07:17:15,214 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=02e1f115dcd2a0d93b9d3bac5716fcc5, regionState=CLOSED 2023-07-13 07:17:15,214 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689232617134.02e1f115dcd2a0d93b9d3bac5716fcc5.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689232635214"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689232635214"}]},"ts":"1689232635214"} 2023-07-13 07:17:15,223 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=88, resume processing ppid=85 2023-07-13 07:17:15,223 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=88, ppid=85, state=SUCCESS; CloseRegionProcedure 1b4802ed4d3dee1e2a4da4cb99644369, server=jenkins-hbase20.apache.org,44195,1689232541463 in 184 msec 2023-07-13 07:17:15,223 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=87, resume processing ppid=86 2023-07-13 07:17:15,223 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=87, ppid=86, state=SUCCESS; CloseRegionProcedure 02e1f115dcd2a0d93b9d3bac5716fcc5, server=jenkins-hbase20.apache.org,42807,1689232541407 in 187 msec 2023-07-13 07:17:15,228 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=1b4802ed4d3dee1e2a4da4cb99644369, UNASSIGN in 200 msec 2023-07-13 07:17:15,230 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=86, resume processing ppid=84 2023-07-13 07:17:15,230 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=02e1f115dcd2a0d93b9d3bac5716fcc5, UNASSIGN in 200 msec 2023-07-13 07:17:15,230 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689232635230"}]},"ts":"1689232635230"} 2023-07-13 07:17:15,232 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-07-13 07:17:15,233 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-07-13 07:17:15,235 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 220 msec 2023-07-13 07:17:15,321 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-13 07:17:15,321 INFO [Listener at jenkins-hbase20.apache.org/34497] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-07-13 07:17:15,322 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.HMaster$5(2228): Client=jenkins//148.251.75.209 delete testtb-testExportFileSystemStateWithMergeRegion 2023-07-13 07:17:15,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] procedure2.ProcedureExecutor(1029): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-13 07:17:15,326 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-13 07:17:15,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-07-13 07:17:15,328 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-13 07:17:15,329 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44607] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-07-13 07:17:15,331 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-13 07:17:15,331 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-13 07:17:15,331 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-13 07:17:15,331 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-13 07:17:15,332 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-13 07:17:15,332 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-13 07:17:15,332 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-13 07:17:15,332 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-13 07:17:15,332 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-13 07:17:15,332 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 07:17:15,333 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-13 07:17:15,333 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-13 07:17:15,333 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 07:17:15,333 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 07:17:15,333 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-13 07:17:15,333 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 07:17:15,334 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-13 07:17:15,334 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/02e1f115dcd2a0d93b9d3bac5716fcc5 2023-07-13 07:17:15,334 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/1b4802ed4d3dee1e2a4da4cb99644369 2023-07-13 07:17:15,336 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/02e1f115dcd2a0d93b9d3bac5716fcc5/cf, FileablePath, hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/02e1f115dcd2a0d93b9d3bac5716fcc5/recovered.edits] 2023-07-13 07:17:15,337 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/1b4802ed4d3dee1e2a4da4cb99644369/cf, FileablePath, hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/1b4802ed4d3dee1e2a4da4cb99644369/recovered.edits] 2023-07-13 07:17:15,341 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/02e1f115dcd2a0d93b9d3bac5716fcc5/cf/8f910e83986d434b9f9693e5db825269 to hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/02e1f115dcd2a0d93b9d3bac5716fcc5/cf/8f910e83986d434b9f9693e5db825269 2023-07-13 07:17:15,342 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/1b4802ed4d3dee1e2a4da4cb99644369/cf/109b8b3833ac457abf2366dc1f514165 to hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/1b4802ed4d3dee1e2a4da4cb99644369/cf/109b8b3833ac457abf2366dc1f514165 2023-07-13 07:17:15,345 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/02e1f115dcd2a0d93b9d3bac5716fcc5/recovered.edits/9.seqid to hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/02e1f115dcd2a0d93b9d3bac5716fcc5/recovered.edits/9.seqid 2023-07-13 07:17:15,346 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/02e1f115dcd2a0d93b9d3bac5716fcc5 2023-07-13 07:17:15,347 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/1b4802ed4d3dee1e2a4da4cb99644369/recovered.edits/9.seqid to hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/1b4802ed4d3dee1e2a4da4cb99644369/recovered.edits/9.seqid 2023-07-13 07:17:15,348 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/1b4802ed4d3dee1e2a4da4cb99644369 2023-07-13 07:17:15,348 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-13 07:17:15,356 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-13 07:17:15,358 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-07-13 07:17:15,360 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-07-13 07:17:15,362 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-13 07:17:15,362 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-07-13 07:17:15,362 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689232617134.1b4802ed4d3dee1e2a4da4cb99644369.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689232635362"}]},"ts":"9223372036854775807"} 2023-07-13 07:17:15,362 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689232617134.02e1f115dcd2a0d93b9d3bac5716fcc5.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689232635362"}]},"ts":"9223372036854775807"} 2023-07-13 07:17:15,364 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-13 07:17:15,364 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 1b4802ed4d3dee1e2a4da4cb99644369, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689232617134.1b4802ed4d3dee1e2a4da4cb99644369.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 02e1f115dcd2a0d93b9d3bac5716fcc5, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689232617134.02e1f115dcd2a0d93b9d3bac5716fcc5.', STARTKEY => '1', ENDKEY => ''}] 2023-07-13 07:17:15,364 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-07-13 07:17:15,364 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689232635364"}]},"ts":"9223372036854775807"} 2023-07-13 07:17:15,371 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-07-13 07:17:15,373 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-13 07:17:15,376 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 51 msec 2023-07-13 07:17:15,435 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-13 07:17:15,435 INFO [Listener at jenkins-hbase20.apache.org/34497] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-07-13 07:17:15,448 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-13 07:17:15,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:17:15,458 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-13 07:17:15,460 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:17:15,462 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-07-13 07:17:15,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:17:15,501 INFO [Listener at jenkins-hbase20.apache.org/34497] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=762 (was 749) Potentially hanging thread: hconnection-0xd7981d0-shared-pool-29 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0xd7981d0-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (788891943) connection to jenkins-hbase20.apache.org/148.251.75.209:44923 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0xd7981d0-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_139625932_17 at /127.0.0.1:45114 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4063 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_139625932_17 at /127.0.0.1:52862 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0xd7981d0-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-762035675_1 at /127.0.0.1:57336 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_139625932_17 at /127.0.0.1:57340 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0xd7981d0-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-762035675_1 at /127.0.0.1:52842 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0xd7981d0-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=916 (was 914) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=528 (was 508) - SystemLoadAverage LEAK? -, ProcessCount=170 (was 170), AvailableMemoryMB=3505 (was 3978) 2023-07-13 07:17:15,501 WARN [Listener at jenkins-hbase20.apache.org/34497] hbase.ResourceChecker(130): Thread=762 is superior to 500 2023-07-13 07:17:15,528 INFO [Listener at jenkins-hbase20.apache.org/34497] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testEmptyExportFileSystemState Thread=762, OpenFileDescriptor=916, MaxFileDescriptor=60000, SystemLoadAverage=528, ProcessCount=170, AvailableMemoryMB=3504 2023-07-13 07:17:15,529 WARN [Listener at jenkins-hbase20.apache.org/34497] hbase.ResourceChecker(130): Thread=762 is superior to 500 2023-07-13 07:17:15,530 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-13 07:17:15,531 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] procedure2.ProcedureExecutor(1029): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-13 07:17:15,535 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-13 07:17:15,536 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-07-13 07:17:15,537 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-13 07:17:15,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-13 07:17:15,540 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testEmptyExportFileSystemState/e769c2959a441642d66d543a61b0eddc 2023-07-13 07:17:15,540 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testEmptyExportFileSystemState/4fb92fbfea92a4cbee44dce153d0c4ea 2023-07-13 07:17:15,541 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testEmptyExportFileSystemState/e769c2959a441642d66d543a61b0eddc empty. 2023-07-13 07:17:15,541 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testEmptyExportFileSystemState/4fb92fbfea92a4cbee44dce153d0c4ea empty. 2023-07-13 07:17:15,541 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testEmptyExportFileSystemState/e769c2959a441642d66d543a61b0eddc 2023-07-13 07:17:15,541 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testEmptyExportFileSystemState/4fb92fbfea92a4cbee44dce153d0c4ea 2023-07-13 07:17:15,542 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-13 07:17:15,565 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-13 07:17:15,567 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 4fb92fbfea92a4cbee44dce153d0c4ea, NAME => 'testtb-testEmptyExportFileSystemState,,1689232635530.4fb92fbfea92a4cbee44dce153d0c4ea.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp 2023-07-13 07:17:15,568 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => e769c2959a441642d66d543a61b0eddc, NAME => 'testtb-testEmptyExportFileSystemState,1,1689232635530.e769c2959a441642d66d543a61b0eddc.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp 2023-07-13 07:17:15,601 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689232635530.4fb92fbfea92a4cbee44dce153d0c4ea.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 07:17:15,602 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 4fb92fbfea92a4cbee44dce153d0c4ea, disabling compactions & flushes 2023-07-13 07:17:15,602 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689232635530.4fb92fbfea92a4cbee44dce153d0c4ea. 2023-07-13 07:17:15,602 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689232635530.4fb92fbfea92a4cbee44dce153d0c4ea. 2023-07-13 07:17:15,602 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689232635530.4fb92fbfea92a4cbee44dce153d0c4ea. after waiting 0 ms 2023-07-13 07:17:15,602 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689232635530.4fb92fbfea92a4cbee44dce153d0c4ea. 2023-07-13 07:17:15,602 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689232635530.4fb92fbfea92a4cbee44dce153d0c4ea. 2023-07-13 07:17:15,602 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 4fb92fbfea92a4cbee44dce153d0c4ea: 2023-07-13 07:17:15,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-13 07:17:15,840 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-13 07:17:16,012 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689232635530.e769c2959a441642d66d543a61b0eddc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 07:17:16,012 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing e769c2959a441642d66d543a61b0eddc, disabling compactions & flushes 2023-07-13 07:17:16,013 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689232635530.e769c2959a441642d66d543a61b0eddc. 2023-07-13 07:17:16,013 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689232635530.e769c2959a441642d66d543a61b0eddc. 2023-07-13 07:17:16,013 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689232635530.e769c2959a441642d66d543a61b0eddc. after waiting 0 ms 2023-07-13 07:17:16,013 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689232635530.e769c2959a441642d66d543a61b0eddc. 2023-07-13 07:17:16,013 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689232635530.e769c2959a441642d66d543a61b0eddc. 2023-07-13 07:17:16,013 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for e769c2959a441642d66d543a61b0eddc: 2023-07-13 07:17:16,024 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-13 07:17:16,026 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689232635530.4fb92fbfea92a4cbee44dce153d0c4ea.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689232636025"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689232636025"}]},"ts":"1689232636025"} 2023-07-13 07:17:16,026 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689232635530.e769c2959a441642d66d543a61b0eddc.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689232636025"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689232636025"}]},"ts":"1689232636025"} 2023-07-13 07:17:16,029 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-13 07:17:16,030 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-13 07:17:16,030 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689232636030"}]},"ts":"1689232636030"} 2023-07-13 07:17:16,032 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-07-13 07:17:16,036 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-07-13 07:17:16,038 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-13 07:17:16,038 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-13 07:17:16,038 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-13 07:17:16,038 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-13 07:17:16,039 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=4fb92fbfea92a4cbee44dce153d0c4ea, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=e769c2959a441642d66d543a61b0eddc, ASSIGN}] 2023-07-13 07:17:16,041 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=4fb92fbfea92a4cbee44dce153d0c4ea, ASSIGN 2023-07-13 07:17:16,041 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=e769c2959a441642d66d543a61b0eddc, ASSIGN 2023-07-13 07:17:16,043 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=4fb92fbfea92a4cbee44dce153d0c4ea, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,44607,1689232541504; forceNewPlan=false, retain=false 2023-07-13 07:17:16,043 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=e769c2959a441642d66d543a61b0eddc, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,42807,1689232541407; forceNewPlan=false, retain=false 2023-07-13 07:17:16,141 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-13 07:17:16,193 INFO [jenkins-hbase20:37475] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-13 07:17:16,197 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=4fb92fbfea92a4cbee44dce153d0c4ea, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:17:16,197 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689232635530.4fb92fbfea92a4cbee44dce153d0c4ea.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689232636197"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689232636197"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689232636197"}]},"ts":"1689232636197"} 2023-07-13 07:17:16,197 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=e769c2959a441642d66d543a61b0eddc, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:17:16,198 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689232635530.e769c2959a441642d66d543a61b0eddc.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689232636197"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689232636197"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689232636197"}]},"ts":"1689232636197"} 2023-07-13 07:17:16,201 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=91, state=RUNNABLE; OpenRegionProcedure 4fb92fbfea92a4cbee44dce153d0c4ea, server=jenkins-hbase20.apache.org,44607,1689232541504}] 2023-07-13 07:17:16,201 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=92, state=RUNNABLE; OpenRegionProcedure e769c2959a441642d66d543a61b0eddc, server=jenkins-hbase20.apache.org,42807,1689232541407}] 2023-07-13 07:17:16,360 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1689232635530.e769c2959a441642d66d543a61b0eddc. 2023-07-13 07:17:16,360 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1689232635530.4fb92fbfea92a4cbee44dce153d0c4ea. 2023-07-13 07:17:16,360 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e769c2959a441642d66d543a61b0eddc, NAME => 'testtb-testEmptyExportFileSystemState,1,1689232635530.e769c2959a441642d66d543a61b0eddc.', STARTKEY => '1', ENDKEY => ''} 2023-07-13 07:17:16,361 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4fb92fbfea92a4cbee44dce153d0c4ea, NAME => 'testtb-testEmptyExportFileSystemState,,1689232635530.4fb92fbfea92a4cbee44dce153d0c4ea.', STARTKEY => '', ENDKEY => '1'} 2023-07-13 07:17:16,361 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1689232635530.4fb92fbfea92a4cbee44dce153d0c4ea. service=AccessControlService 2023-07-13 07:17:16,361 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1689232635530.e769c2959a441642d66d543a61b0eddc. service=AccessControlService 2023-07-13 07:17:16,361 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-13 07:17:16,361 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-13 07:17:16,361 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 4fb92fbfea92a4cbee44dce153d0c4ea 2023-07-13 07:17:16,361 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState e769c2959a441642d66d543a61b0eddc 2023-07-13 07:17:16,361 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689232635530.4fb92fbfea92a4cbee44dce153d0c4ea.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 07:17:16,361 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689232635530.e769c2959a441642d66d543a61b0eddc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 07:17:16,361 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for e769c2959a441642d66d543a61b0eddc 2023-07-13 07:17:16,361 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for e769c2959a441642d66d543a61b0eddc 2023-07-13 07:17:16,361 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 4fb92fbfea92a4cbee44dce153d0c4ea 2023-07-13 07:17:16,362 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 4fb92fbfea92a4cbee44dce153d0c4ea 2023-07-13 07:17:16,363 INFO [StoreOpener-e769c2959a441642d66d543a61b0eddc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region e769c2959a441642d66d543a61b0eddc 2023-07-13 07:17:16,364 INFO [StoreOpener-4fb92fbfea92a4cbee44dce153d0c4ea-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 4fb92fbfea92a4cbee44dce153d0c4ea 2023-07-13 07:17:16,365 DEBUG [StoreOpener-e769c2959a441642d66d543a61b0eddc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testEmptyExportFileSystemState/e769c2959a441642d66d543a61b0eddc/cf 2023-07-13 07:17:16,365 DEBUG [StoreOpener-e769c2959a441642d66d543a61b0eddc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testEmptyExportFileSystemState/e769c2959a441642d66d543a61b0eddc/cf 2023-07-13 07:17:16,366 DEBUG [StoreOpener-4fb92fbfea92a4cbee44dce153d0c4ea-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testEmptyExportFileSystemState/4fb92fbfea92a4cbee44dce153d0c4ea/cf 2023-07-13 07:17:16,366 DEBUG [StoreOpener-4fb92fbfea92a4cbee44dce153d0c4ea-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testEmptyExportFileSystemState/4fb92fbfea92a4cbee44dce153d0c4ea/cf 2023-07-13 07:17:16,366 INFO [StoreOpener-e769c2959a441642d66d543a61b0eddc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e769c2959a441642d66d543a61b0eddc columnFamilyName cf 2023-07-13 07:17:16,366 INFO [StoreOpener-4fb92fbfea92a4cbee44dce153d0c4ea-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4fb92fbfea92a4cbee44dce153d0c4ea columnFamilyName cf 2023-07-13 07:17:16,366 INFO [StoreOpener-e769c2959a441642d66d543a61b0eddc-1] regionserver.HStore(310): Store=e769c2959a441642d66d543a61b0eddc/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-13 07:17:16,367 INFO [StoreOpener-4fb92fbfea92a4cbee44dce153d0c4ea-1] regionserver.HStore(310): Store=4fb92fbfea92a4cbee44dce153d0c4ea/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-13 07:17:16,367 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testEmptyExportFileSystemState/e769c2959a441642d66d543a61b0eddc 2023-07-13 07:17:16,368 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testEmptyExportFileSystemState/4fb92fbfea92a4cbee44dce153d0c4ea 2023-07-13 07:17:16,368 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testEmptyExportFileSystemState/e769c2959a441642d66d543a61b0eddc 2023-07-13 07:17:16,368 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testEmptyExportFileSystemState/4fb92fbfea92a4cbee44dce153d0c4ea 2023-07-13 07:17:16,370 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for e769c2959a441642d66d543a61b0eddc 2023-07-13 07:17:16,371 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 4fb92fbfea92a4cbee44dce153d0c4ea 2023-07-13 07:17:16,374 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testEmptyExportFileSystemState/e769c2959a441642d66d543a61b0eddc/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-13 07:17:16,374 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testEmptyExportFileSystemState/4fb92fbfea92a4cbee44dce153d0c4ea/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-13 07:17:16,374 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened e769c2959a441642d66d543a61b0eddc; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71681528, jitterRate=0.0681380033493042}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-13 07:17:16,374 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for e769c2959a441642d66d543a61b0eddc: 2023-07-13 07:17:16,375 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 4fb92fbfea92a4cbee44dce153d0c4ea; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67210228, jitterRate=0.0015104413032531738}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-13 07:17:16,375 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 4fb92fbfea92a4cbee44dce153d0c4ea: 2023-07-13 07:17:16,375 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1689232635530.e769c2959a441642d66d543a61b0eddc., pid=94, masterSystemTime=1689232636355 2023-07-13 07:17:16,375 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1689232635530.4fb92fbfea92a4cbee44dce153d0c4ea., pid=93, masterSystemTime=1689232636355 2023-07-13 07:17:16,377 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1689232635530.4fb92fbfea92a4cbee44dce153d0c4ea. 2023-07-13 07:17:16,377 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1689232635530.4fb92fbfea92a4cbee44dce153d0c4ea. 2023-07-13 07:17:16,377 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=4fb92fbfea92a4cbee44dce153d0c4ea, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:17:16,377 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1689232635530.e769c2959a441642d66d543a61b0eddc. 2023-07-13 07:17:16,377 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1689232635530.e769c2959a441642d66d543a61b0eddc. 2023-07-13 07:17:16,377 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1689232635530.4fb92fbfea92a4cbee44dce153d0c4ea.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689232636377"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689232636377"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689232636377"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689232636377"}]},"ts":"1689232636377"} 2023-07-13 07:17:16,378 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=e769c2959a441642d66d543a61b0eddc, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:17:16,378 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1689232635530.e769c2959a441642d66d543a61b0eddc.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689232636378"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689232636378"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689232636378"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689232636378"}]},"ts":"1689232636378"} 2023-07-13 07:17:16,380 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=91 2023-07-13 07:17:16,380 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=91, state=SUCCESS; OpenRegionProcedure 4fb92fbfea92a4cbee44dce153d0c4ea, server=jenkins-hbase20.apache.org,44607,1689232541504 in 177 msec 2023-07-13 07:17:16,381 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=92 2023-07-13 07:17:16,381 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=92, state=SUCCESS; OpenRegionProcedure e769c2959a441642d66d543a61b0eddc, server=jenkins-hbase20.apache.org,42807,1689232541407 in 178 msec 2023-07-13 07:17:16,382 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=4fb92fbfea92a4cbee44dce153d0c4ea, ASSIGN in 341 msec 2023-07-13 07:17:16,382 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=92, resume processing ppid=90 2023-07-13 07:17:16,383 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=e769c2959a441642d66d543a61b0eddc, ASSIGN in 342 msec 2023-07-13 07:17:16,383 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-13 07:17:16,383 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689232636383"}]},"ts":"1689232636383"} 2023-07-13 07:17:16,384 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-07-13 07:17:16,385 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-13 07:17:16,386 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-07-13 07:17:16,387 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44607] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-13 07:17:16,388 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 07:17:16,388 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 07:17:16,388 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 07:17:16,388 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 07:17:16,389 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-13 07:17:16,389 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-13 07:17:16,390 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-13 07:17:16,390 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-13 07:17:16,392 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 859 msec 2023-07-13 07:17:16,642 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-13 07:17:16,643 INFO [Listener at jenkins-hbase20.apache.org/34497] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-07-13 07:17:16,643 DEBUG [Listener at jenkins-hbase20.apache.org/34497] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testEmptyExportFileSystemState get assigned. Timeout = 60000ms 2023-07-13 07:17:16,643 INFO [Listener at jenkins-hbase20.apache.org/34497] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-13 07:17:16,647 INFO [Listener at jenkins-hbase20.apache.org/34497] hbase.HBaseTestingUtility(3484): All regions for table testtb-testEmptyExportFileSystemState assigned to meta. Checking AM states. 2023-07-13 07:17:16,648 INFO [Listener at jenkins-hbase20.apache.org/34497] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-13 07:17:16,648 INFO [Listener at jenkins-hbase20.apache.org/34497] hbase.HBaseTestingUtility(3504): All regions for table testtb-testEmptyExportFileSystemState assigned. 2023-07-13 07:17:16,656 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-13 07:17:16,656 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689232636656 (current time:1689232636656). 2023-07-13 07:17:16,656 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-13 07:17:16,656 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] zookeeper.ReadOnlyZKClient(139): Connect 0x6332b999 to 127.0.0.1:58099 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-13 07:17:16,667 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5e6125bb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-13 07:17:16,672 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 07:17:16,673 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:57470, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 07:17:16,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6332b999 to 127.0.0.1:58099 2023-07-13 07:17:16,675 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 07:17:16,675 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] zookeeper.ReadOnlyZKClient(139): Connect 0x5e246828 to 127.0.0.1:58099 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-13 07:17:16,696 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@282cec04, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-13 07:17:16,697 DEBUG [hconnection-0x7f374847-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 07:17:16,702 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:57480, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 07:17:16,707 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 07:17:16,711 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:42008, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 07:17:16,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5e246828 to 127.0.0.1:58099 2023-07-13 07:17:16,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 07:17:16,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-13 07:17:16,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-13 07:17:16,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-13 07:17:16,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-13 07:17:16,718 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-13 07:17:16,718 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689233236718 2023-07-13 07:17:16,718 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-13 07:17:16,718 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-13 07:17:16,720 DEBUG [Listener at jenkins-hbase20.apache.org/34497] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-13 07:17:16,720 DEBUG [Listener at jenkins-hbase20.apache.org/34497] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-13 07:17:16,720 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-13 07:17:16,722 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-13 07:17:16,723 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 7 msec 2023-07-13 07:17:16,727 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-13 07:17:16,728 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689233236728 2023-07-13 07:17:16,739 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:16,740 INFO [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-07-13 07:17:16,740 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 07:17:16,741 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-13 07:17:16,741 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-13 07:17:16,741 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:16,741 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:16,743 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:17:16,743 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:17:16,743 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:17:16,743 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:17:16,743 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:17:16,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:17:16,743 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:17:16,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:17:16,743 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:17:16,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:17:16,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:16,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:16,748 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:17:16,748 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:17:16,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:16,748 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:16,748 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:16,748 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:16,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-13 07:17:16,748 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:17:16,748 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-13 07:17:16,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:16,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-13 07:17:16,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:16,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-13 07:17:16,749 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-13 07:17:16,749 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-13 07:17:16,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:16,749 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-13 07:17:16,749 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:16,749 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:16,749 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-13 07:17:16,749 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:16,749 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-13 07:17:16,749 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-13 07:17:16,749 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 07:17:16,749 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 07:17:16,749 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 07:17:16,752 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-13 07:17:16,753 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-13 07:17:16,753 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44195,1689232541463' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-13 07:17:16,751 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-13 07:17:16,753 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-13 07:17:16,753 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-13 07:17:16,753 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-13 07:17:16,753 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,42807,1689232541407' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-13 07:17:16,753 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44607,1689232541504' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-13 07:17:16,766 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:16,767 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:16,767 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:17:16,767 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:16,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:17:16,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 07:17:16,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 07:17:16,767 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 07:17:16,767 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:17:16,767 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:16,767 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:16,767 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 07:17:16,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 07:17:16,767 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:16,767 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 07:17:16,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 07:17:16,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:16,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:17:16,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:17:16,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:17:16,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 07:17:16,769 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44607,1689232541504' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-13 07:17:16,769 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@710abe74[Count = 1] remaining members to acquire global barrier 2023-07-13 07:17:16,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:17:16,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 07:17:16,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 07:17:16,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 07:17:16,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 07:17:16,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:16,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:17:16,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:17:16,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:17:16,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 07:17:16,771 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,42807,1689232541407' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-13 07:17:16,771 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@710abe74[Count = 0] remaining members to acquire global barrier 2023-07-13 07:17:16,771 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-13 07:17:16,771 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:16,772 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:16,772 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:16,772 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:16,772 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:16,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:16,772 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:17:16,772 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:16,772 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-13 07:17:16,772 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-13 07:17:16,772 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:16,772 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase20.apache.org,44195,1689232541463' in zk 2023-07-13 07:17:16,772 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:17:16,772 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-13 07:17:16,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:16,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:16,773 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-13 07:17:16,773 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-13 07:17:16,773 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-13 07:17:16,773 DEBUG [rs(jenkins-hbase20.apache.org,42807,1689232541407)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689232635530.e769c2959a441642d66d543a61b0eddc. 2023-07-13 07:17:16,773 DEBUG [rs(jenkins-hbase20.apache.org,42807,1689232541407)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689232635530.e769c2959a441642d66d543a61b0eddc. started... 2023-07-13 07:17:16,773 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-13 07:17:16,773 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 07:17:16,773 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-13 07:17:16,775 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-13 07:17:16,775 DEBUG [rs(jenkins-hbase20.apache.org,42807,1689232541407)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e769c2959a441642d66d543a61b0eddc: 2023-07-13 07:17:16,775 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-13 07:17:16,775 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-13 07:17:16,776 DEBUG [rs(jenkins-hbase20.apache.org,42807,1689232541407)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689232635530.e769c2959a441642d66d543a61b0eddc.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:16,776 DEBUG [rs(jenkins-hbase20.apache.org,42807,1689232541407)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-13 07:17:16,776 DEBUG [rs(jenkins-hbase20.apache.org,42807,1689232541407)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-13 07:17:16,775 DEBUG [rs(jenkins-hbase20.apache.org,44607,1689232541504)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689232635530.4fb92fbfea92a4cbee44dce153d0c4ea. 2023-07-13 07:17:16,777 DEBUG [rs(jenkins-hbase20.apache.org,44607,1689232541504)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689232635530.4fb92fbfea92a4cbee44dce153d0c4ea. started... 2023-07-13 07:17:16,780 DEBUG [rs(jenkins-hbase20.apache.org,44607,1689232541504)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4fb92fbfea92a4cbee44dce153d0c4ea: 2023-07-13 07:17:16,780 DEBUG [rs(jenkins-hbase20.apache.org,44607,1689232541504)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689232635530.4fb92fbfea92a4cbee44dce153d0c4ea.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:16,780 DEBUG [rs(jenkins-hbase20.apache.org,44607,1689232541504)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-13 07:17:16,780 DEBUG [rs(jenkins-hbase20.apache.org,44607,1689232541504)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-13 07:17:16,807 DEBUG [rs(jenkins-hbase20.apache.org,42807,1689232541407)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689232635530.e769c2959a441642d66d543a61b0eddc. completed. 2023-07-13 07:17:16,808 DEBUG [rs(jenkins-hbase20.apache.org,42807,1689232541407)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689232635530.e769c2959a441642d66d543a61b0eddc. 2023-07-13 07:17:16,808 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-13 07:17:16,808 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-13 07:17:16,808 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:17:16,808 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-13 07:17:16,808 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase20.apache.org,42807,1689232541407' in zk 2023-07-13 07:17:16,810 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-13 07:17:16,810 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:17:16,810 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 07:17:16,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:17:16,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 07:17:16,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 07:17:16,810 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-13 07:17:16,812 DEBUG [rs(jenkins-hbase20.apache.org,44607,1689232541504)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689232635530.4fb92fbfea92a4cbee44dce153d0c4ea. completed. 2023-07-13 07:17:16,812 DEBUG [rs(jenkins-hbase20.apache.org,44607,1689232541504)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689232635530.4fb92fbfea92a4cbee44dce153d0c4ea. 2023-07-13 07:17:16,812 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-13 07:17:16,812 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-13 07:17:16,812 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:17:16,813 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-13 07:17:16,813 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase20.apache.org,44607,1689232541504' in zk 2023-07-13 07:17:16,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 07:17:16,814 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:17:16,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 07:17:16,814 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-13 07:17:16,814 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 07:17:16,814 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-13 07:17:16,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:16,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:17:16,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:17:16,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:17:16,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 07:17:16,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:16,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:17:16,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:17:16,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:17:16,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase20.apache.org,42807,1689232541407': 2023-07-13 07:17:16,819 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,42807,1689232541407' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-13 07:17:16,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:17:16,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 07:17:16,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 07:17:16,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 07:17:16,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 07:17:16,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:16,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:17:16,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:17:16,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:17:16,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 07:17:16,820 DEBUG [Listener at jenkins-hbase20.apache.org/34497] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 07:17:16,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:16,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:17:16,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:17:16,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-13 07:17:16,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:17:16,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-13 07:17:16,821 DEBUG [Listener at jenkins-hbase20.apache.org/34497] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-13 07:17:16,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase20.apache.org,44607,1689232541504': 2023-07-13 07:17:16,822 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44607,1689232541504' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-13 07:17:16,822 INFO [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-07-13 07:17:16,822 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-13 07:17:16,822 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-13 07:17:16,822 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:16,822 INFO [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-13 07:17:16,828 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:16,828 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:17:16,829 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:16,829 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:17:16,829 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:16,829 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:16,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:16,829 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:16,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:16,829 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:17:16,829 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:16,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:16,829 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:16,829 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:17:16,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:16,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 07:17:16,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 07:17:16,829 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:17:16,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:17:16,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:17:16,830 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:17:16,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:17:16,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:16,831 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:17:16,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:16,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:16,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 07:17:16,831 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:17:16,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:16,832 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:17:16,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 07:17:16,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:16,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:17:16,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:17:16,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:17:16,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 07:17:16,833 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:17:16,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:16,834 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:17:16,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:17:16,834 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:17:16,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:17:16,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:17:16,837 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:17:16,837 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:17:16,837 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:17:16,837 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:17:16,837 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:17:16,837 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:17:16,837 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:17:16,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:17:16,837 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:17:16,837 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:16,837 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:17:16,837 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 07:17:16,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:17:16,837 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:17:16,837 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:17:16,837 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:17:16,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:17:16,837 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:16,837 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:17:16,837 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:16,837 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:16,837 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:17:16,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:17:16,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:17:16,838 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:17:16,838 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:16,838 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:17:16,838 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:17:16,838 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:16,838 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:16,838 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:17:16,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:17:16,838 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:16,856 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:16,873 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-13 07:17:16,873 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:16,874 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:16,874 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689232636718Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689232636837 (+119 ms)Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1689232636838 (+1 ms)Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1689232636841 (+3 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689232636851 (+10 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689232636873 (+22 ms) 2023-07-13 07:17:16,878 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-13 07:17:16,879 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 158 msec 2023-07-13 07:17:17,022 DEBUG [Listener at jenkins-hbase20.apache.org/34497] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 07:17:17,025 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-13 07:17:17,025 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-13 07:17:17,056 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44607] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1689232635530.4fb92fbfea92a4cbee44dce153d0c4ea. with WAL disabled. Data may be lost in the event of a crash. 2023-07-13 07:17:17,057 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42807] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1689232635530.e769c2959a441642d66d543a61b0eddc. with WAL disabled. Data may be lost in the event of a crash. 2023-07-13 07:17:17,061 DEBUG [Listener at jenkins-hbase20.apache.org/34497] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-13 07:17:17,061 DEBUG [Listener at jenkins-hbase20.apache.org/34497] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1689232635530.4fb92fbfea92a4cbee44dce153d0c4ea. 2023-07-13 07:17:17,061 INFO [Listener at jenkins-hbase20.apache.org/34497] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-13 07:17:17,074 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-13 07:17:17,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689232637074 (current time:1689232637074). 2023-07-13 07:17:17,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-13 07:17:17,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] zookeeper.ReadOnlyZKClient(139): Connect 0x2458d8ce to 127.0.0.1:58099 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-13 07:17:17,081 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6168d972, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-13 07:17:17,082 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 07:17:17,086 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:57482, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 07:17:17,087 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2458d8ce to 127.0.0.1:58099 2023-07-13 07:17:17,087 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 07:17:17,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] zookeeper.ReadOnlyZKClient(139): Connect 0x5e31b1e6 to 127.0.0.1:58099 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-13 07:17:17,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3c4d9c46, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-13 07:17:17,099 DEBUG [hconnection-0x1bc971f4-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 07:17:17,100 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:57484, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 07:17:17,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 07:17:17,112 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:42010, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 07:17:17,124 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5e31b1e6 to 127.0.0.1:58099 2023-07-13 07:17:17,124 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 07:17:17,124 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-13 07:17:17,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-13 07:17:17,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-13 07:17:17,127 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-13 07:17:17,146 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-13 07:17:17,152 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689233237152 2023-07-13 07:17:17,152 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-13 07:17:17,152 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-13 07:17:17,154 DEBUG [Listener at jenkins-hbase20.apache.org/34497] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-13 07:17:17,154 DEBUG [Listener at jenkins-hbase20.apache.org/34497] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-13 07:17:17,156 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1029): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-13 07:17:17,156 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-13 07:17:17,157 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 29 msec 2023-07-13 07:17:17,158 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-13 07:17:17,159 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689233237159 2023-07-13 07:17:17,175 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:17,175 INFO [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-07-13 07:17:17,175 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 07:17:17,176 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-13 07:17:17,176 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-13 07:17:17,177 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:17,177 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:17,177 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:17:17,177 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:17:17,178 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:17:17,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:17:17,178 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:17:17,177 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:17:17,177 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:17:17,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:17:17,178 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:17:17,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:17:17,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:17,178 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:17:17,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:17,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:17,178 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:17:17,178 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:17,178 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:17,178 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:17,178 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:17:17,179 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-13 07:17:17,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-13 07:17:17,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-13 07:17:17,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:17,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-13 07:17:17,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:17,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:17,179 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-13 07:17:17,179 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-13 07:17:17,179 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-13 07:17:17,179 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:17,179 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-13 07:17:17,179 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 07:17:17,182 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:17,185 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:17,184 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-13 07:17:17,185 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-13 07:17:17,185 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 07:17:17,185 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-13 07:17:17,186 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-13 07:17:17,187 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-13 07:17:17,185 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-13 07:17:17,187 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44195,1689232541463' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-13 07:17:17,187 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 07:17:17,187 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44607,1689232541504' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-13 07:17:17,189 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-13 07:17:17,189 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-13 07:17:17,189 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,42807,1689232541407' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-13 07:17:17,195 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:17,197 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:17,197 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:17,197 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:17,197 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 07:17:17,197 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:17:17,197 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:17:17,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:17:17,197 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:17,197 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 07:17:17,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 07:17:17,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 07:17:17,197 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:17,197 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 07:17:17,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 07:17:17,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 07:17:17,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:17,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:17:17,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:17:17,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:17:17,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 07:17:17,199 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,42807,1689232541407' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-13 07:17:17,199 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5e92ef8[Count = 1] remaining members to acquire global barrier 2023-07-13 07:17:17,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:17:17,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 07:17:17,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 07:17:17,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 07:17:17,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 07:17:17,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:17,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:17:17,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:17:17,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:17:17,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 07:17:17,201 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44607,1689232541504' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-13 07:17:17,201 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5e92ef8[Count = 0] remaining members to acquire global barrier 2023-07-13 07:17:17,201 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-13 07:17:17,201 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:17,208 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:17,208 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:17,208 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:17,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:17,208 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:17,209 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:17:17,209 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:17,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:17,209 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-13 07:17:17,208 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:17,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:17,209 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:17:17,209 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-13 07:17:17,209 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-13 07:17:17,209 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-13 07:17:17,209 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase20.apache.org,44195,1689232541463' in zk 2023-07-13 07:17:17,209 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-13 07:17:17,209 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-13 07:17:17,209 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-13 07:17:17,209 DEBUG [rs(jenkins-hbase20.apache.org,42807,1689232541407)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689232635530.e769c2959a441642d66d543a61b0eddc. 2023-07-13 07:17:17,209 DEBUG [rs(jenkins-hbase20.apache.org,42807,1689232541407)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689232635530.e769c2959a441642d66d543a61b0eddc. started... 2023-07-13 07:17:17,209 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-13 07:17:17,210 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-13 07:17:17,210 DEBUG [rs(jenkins-hbase20.apache.org,44607,1689232541504)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689232635530.4fb92fbfea92a4cbee44dce153d0c4ea. 2023-07-13 07:17:17,210 INFO [rs(jenkins-hbase20.apache.org,42807,1689232541407)-snapshot-pool-0] regionserver.HRegion(2745): Flushing e769c2959a441642d66d543a61b0eddc 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-07-13 07:17:17,210 DEBUG [rs(jenkins-hbase20.apache.org,44607,1689232541504)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689232635530.4fb92fbfea92a4cbee44dce153d0c4ea. started... 2023-07-13 07:17:17,210 INFO [rs(jenkins-hbase20.apache.org,44607,1689232541504)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 4fb92fbfea92a4cbee44dce153d0c4ea 1/1 column families, dataSize=132 B heapSize=544 B 2023-07-13 07:17:17,213 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-13 07:17:17,213 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 07:17:17,213 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-13 07:17:17,243 INFO [rs(jenkins-hbase20.apache.org,44607,1689232541504)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=132 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testEmptyExportFileSystemState/4fb92fbfea92a4cbee44dce153d0c4ea/.tmp/cf/f184c33e8b4c4ff9bd459d0de16767ef 2023-07-13 07:17:17,247 INFO [rs(jenkins-hbase20.apache.org,42807,1689232541407)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.13 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testEmptyExportFileSystemState/e769c2959a441642d66d543a61b0eddc/.tmp/cf/8fe117f64b624d71b836cd939a370a0b 2023-07-13 07:17:17,254 DEBUG [Listener at jenkins-hbase20.apache.org/34497] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 07:17:17,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-13 07:17:17,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-13 07:17:17,256 DEBUG [rs(jenkins-hbase20.apache.org,42807,1689232541407)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testEmptyExportFileSystemState/e769c2959a441642d66d543a61b0eddc/.tmp/cf/8fe117f64b624d71b836cd939a370a0b as hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testEmptyExportFileSystemState/e769c2959a441642d66d543a61b0eddc/cf/8fe117f64b624d71b836cd939a370a0b 2023-07-13 07:17:17,256 DEBUG [Listener at jenkins-hbase20.apache.org/34497] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-13 07:17:17,258 DEBUG [rs(jenkins-hbase20.apache.org,44607,1689232541504)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testEmptyExportFileSystemState/4fb92fbfea92a4cbee44dce153d0c4ea/.tmp/cf/f184c33e8b4c4ff9bd459d0de16767ef as hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testEmptyExportFileSystemState/4fb92fbfea92a4cbee44dce153d0c4ea/cf/f184c33e8b4c4ff9bd459d0de16767ef 2023-07-13 07:17:17,265 INFO [rs(jenkins-hbase20.apache.org,42807,1689232541407)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testEmptyExportFileSystemState/e769c2959a441642d66d543a61b0eddc/cf/8fe117f64b624d71b836cd939a370a0b, entries=48, sequenceid=6, filesize=8.1 K 2023-07-13 07:17:17,266 INFO [rs(jenkins-hbase20.apache.org,42807,1689232541407)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for e769c2959a441642d66d543a61b0eddc in 57ms, sequenceid=6, compaction requested=false 2023-07-13 07:17:17,266 DEBUG [rs(jenkins-hbase20.apache.org,42807,1689232541407)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-07-13 07:17:17,267 DEBUG [rs(jenkins-hbase20.apache.org,42807,1689232541407)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e769c2959a441642d66d543a61b0eddc: 2023-07-13 07:17:17,268 DEBUG [rs(jenkins-hbase20.apache.org,42807,1689232541407)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689232635530.e769c2959a441642d66d543a61b0eddc.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:17,269 DEBUG [rs(jenkins-hbase20.apache.org,42807,1689232541407)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-13 07:17:17,269 DEBUG [rs(jenkins-hbase20.apache.org,42807,1689232541407)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testEmptyExportFileSystemState/e769c2959a441642d66d543a61b0eddc/cf/8fe117f64b624d71b836cd939a370a0b] hfiles 2023-07-13 07:17:17,270 DEBUG [rs(jenkins-hbase20.apache.org,42807,1689232541407)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testEmptyExportFileSystemState/e769c2959a441642d66d543a61b0eddc/cf/8fe117f64b624d71b836cd939a370a0b for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:17,274 INFO [rs(jenkins-hbase20.apache.org,44607,1689232541504)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testEmptyExportFileSystemState/4fb92fbfea92a4cbee44dce153d0c4ea/cf/f184c33e8b4c4ff9bd459d0de16767ef, entries=2, sequenceid=6, filesize=5.0 K 2023-07-13 07:17:17,275 INFO [rs(jenkins-hbase20.apache.org,44607,1689232541504)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for 4fb92fbfea92a4cbee44dce153d0c4ea in 65ms, sequenceid=6, compaction requested=false 2023-07-13 07:17:17,280 DEBUG [rs(jenkins-hbase20.apache.org,44607,1689232541504)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4fb92fbfea92a4cbee44dce153d0c4ea: 2023-07-13 07:17:17,281 DEBUG [rs(jenkins-hbase20.apache.org,44607,1689232541504)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689232635530.4fb92fbfea92a4cbee44dce153d0c4ea.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:17,281 DEBUG [rs(jenkins-hbase20.apache.org,44607,1689232541504)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-13 07:17:17,281 DEBUG [rs(jenkins-hbase20.apache.org,44607,1689232541504)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testEmptyExportFileSystemState/4fb92fbfea92a4cbee44dce153d0c4ea/cf/f184c33e8b4c4ff9bd459d0de16767ef] hfiles 2023-07-13 07:17:17,281 DEBUG [rs(jenkins-hbase20.apache.org,44607,1689232541504)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testEmptyExportFileSystemState/4fb92fbfea92a4cbee44dce153d0c4ea/cf/f184c33e8b4c4ff9bd459d0de16767ef for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:17,323 DEBUG [rs(jenkins-hbase20.apache.org,42807,1689232541407)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689232635530.e769c2959a441642d66d543a61b0eddc. completed. 2023-07-13 07:17:17,323 DEBUG [rs(jenkins-hbase20.apache.org,42807,1689232541407)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689232635530.e769c2959a441642d66d543a61b0eddc. 2023-07-13 07:17:17,324 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-13 07:17:17,324 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-13 07:17:17,324 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:17:17,324 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-13 07:17:17,324 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase20.apache.org,42807,1689232541407' in zk 2023-07-13 07:17:17,325 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:17:17,325 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-13 07:17:17,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:17:17,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 07:17:17,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 07:17:17,325 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 07:17:17,325 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-13 07:17:17,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 07:17:17,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 07:17:17,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:17,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:17:17,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:17:17,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:17:17,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 07:17:17,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:17,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:17:17,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:17:17,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase20.apache.org,42807,1689232541407': 2023-07-13 07:17:17,331 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,42807,1689232541407' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-13 07:17:17,457 DEBUG [Listener at jenkins-hbase20.apache.org/34497] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 07:17:17,458 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-13 07:17:17,458 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-13 07:17:17,458 DEBUG [Listener at jenkins-hbase20.apache.org/34497] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-13 07:17:17,756 DEBUG [rs(jenkins-hbase20.apache.org,44607,1689232541504)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689232635530.4fb92fbfea92a4cbee44dce153d0c4ea. completed. 2023-07-13 07:17:17,756 DEBUG [rs(jenkins-hbase20.apache.org,44607,1689232541504)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689232635530.4fb92fbfea92a4cbee44dce153d0c4ea. 2023-07-13 07:17:17,756 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-13 07:17:17,756 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-13 07:17:17,756 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:17:17,756 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-13 07:17:17,756 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase20.apache.org,44607,1689232541504' in zk 2023-07-13 07:17:17,757 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:17:17,757 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-13 07:17:17,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:17:17,757 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 07:17:17,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 07:17:17,759 DEBUG [Listener at jenkins-hbase20.apache.org/34497] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 07:17:17,758 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-13 07:17:17,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 07:17:17,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 07:17:17,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 07:17:17,760 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-13 07:17:17,760 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-13 07:17:17,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:17,760 DEBUG [Listener at jenkins-hbase20.apache.org/34497] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-13 07:17:17,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:17:17,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:17:17,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:17:17,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 07:17:17,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:17,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:17:17,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:17:17,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:17:17,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase20.apache.org,44607,1689232541504': 2023-07-13 07:17:17,763 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44607,1689232541504' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-13 07:17:17,763 INFO [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-07-13 07:17:17,763 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-13 07:17:17,763 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-13 07:17:17,763 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:17,763 INFO [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-13 07:17:17,764 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:17,764 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:17,764 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:17,764 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:17:17,764 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:17,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:17,764 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:17:17,764 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:17,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:17,764 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:17,764 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:17:17,764 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:17,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:17,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 07:17:17,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 07:17:17,765 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:17:17,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:17:17,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:17,765 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:17:17,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:17:17,765 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:17:17,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:17:17,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:17,766 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:17:17,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:17,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 07:17:17,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:17,766 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:17:17,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:17,767 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:17:17,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 07:17:17,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:17,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:17:17,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:17:17,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:17:17,770 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:17:17,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 07:17:17,770 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:17:17,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:17,771 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:17:17,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:17:17,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:17:17,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:17:17,775 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:17:17,775 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:17:17,775 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:17,775 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:17:17,775 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:17:17,775 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:17,775 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:17:17,775 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:17,775 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:17:17,775 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:17,775 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 07:17:17,775 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:17:17,775 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:17:17,777 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:17,777 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:17:17,777 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:17:17,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:17:17,775 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:17:17,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:17:17,777 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:17:17,777 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:17,778 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:17,778 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:17,778 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:17:17,778 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:17:17,778 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:17:17,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:17:17,778 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:17:17,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:17:17,778 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:17:17,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:17:17,779 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:17:17,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:17:17,851 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:17,891 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-13 07:17:17,892 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:17,892 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:17,892 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689232637152Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1689232637775 (+623 ms)Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1689232637775Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1689232637804 (+29 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1689232637839 (+35 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689232637891 (+52 ms) 2023-07-13 07:17:17,898 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-13 07:17:17,900 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 744 msec 2023-07-13 07:17:18,261 DEBUG [Listener at jenkins-hbase20.apache.org/34497] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 07:17:18,261 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-13 07:17:18,261 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-13 07:17:18,262 INFO [Listener at jenkins-hbase20.apache.org/34497] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/export-test/export-1689232638262 2023-07-13 07:17:18,262 INFO [Listener at jenkins-hbase20.apache.org/34497] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost.localdomain:40681, tgtDir=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/export-test/export-1689232638262, rawTgtDir=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/export-test/export-1689232638262, srcFsUri=hdfs://localhost.localdomain:40681, srcDir=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e 2023-07-13 07:17:18,284 DEBUG [Listener at jenkins-hbase20.apache.org/34497] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost.localdomain:40681, inputRoot=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e 2023-07-13 07:17:18,284 DEBUG [Listener at jenkins-hbase20.apache.org/34497] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-358931985_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/export-test/export-1689232638262, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/export-test/export-1689232638262/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:18,284 INFO [Listener at jenkins-hbase20.apache.org/34497] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost.localdomain:40681, inputRoot=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e, snapshotDir=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-07-13 07:17:18,289 INFO [Listener at jenkins-hbase20.apache.org/34497] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/export-test/export-1689232638262/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:18,313 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-13 07:17:18,314 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-13 07:17:18,314 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-13 07:17:18,314 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-13 07:17:18,315 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-13 07:17:18,315 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-13 07:17:18,315 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-13 07:17:18,383 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a827846-4542-2630-0c34-c6bc20d13d68/hadoop-7426996515381581133.jar 2023-07-13 07:17:18,384 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-13 07:17:18,384 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-13 07:17:18,384 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-13 07:17:18,385 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-13 07:17:18,385 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-13 07:17:18,385 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-13 07:17:18,386 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-13 07:17:18,386 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-13 07:17:18,387 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-13 07:17:18,387 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-13 07:17:18,387 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-13 07:17:18,388 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-13 07:17:18,388 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-13 07:17:18,389 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-13 07:17:18,389 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-13 07:17:18,389 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-13 07:17:18,390 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-13 07:17:18,390 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-13 07:17:18,391 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-13 07:17:18,391 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-13 07:17:18,391 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-13 07:17:18,392 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-13 07:17:18,392 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-13 07:17:18,940 WARN [Listener at jenkins-hbase20.apache.org/34497] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-13 07:17:18,942 INFO [Listener at jenkins-hbase20.apache.org/34497] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-07-13 07:17:19,250 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689232548306_0005_000001 (auth:SIMPLE) 2023-07-13 07:17:19,405 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-13 07:17:19,405 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-13 07:17:19,880 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689232548306_0006_000001 (auth:SIMPLE) 2023-07-13 07:17:20,379 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-13 07:17:24,847 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689232548306_0006_000001 (auth:SIMPLE) 2023-07-13 07:17:27,716 INFO [Listener at jenkins-hbase20.apache.org/34497] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-13 07:17:27,717 INFO [Listener at jenkins-hbase20.apache.org/34497] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-13 07:17:27,721 INFO [Listener at jenkins-hbase20.apache.org/34497] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:27,722 INFO [Listener at jenkins-hbase20.apache.org/34497] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-13 07:17:27,722 INFO [Listener at jenkins-hbase20.apache.org/34497] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-13 07:17:27,722 DEBUG [Listener at jenkins-hbase20.apache.org/34497] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_139625932_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:27,723 DEBUG [Listener at jenkins-hbase20.apache.org/34497] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-13 07:17:27,723 DEBUG [Listener at jenkins-hbase20.apache.org/34497] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-13 07:17:27,723 DEBUG [Listener at jenkins-hbase20.apache.org/34497] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_139625932_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/export-test/export-1689232638262/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/export-test/export-1689232638262/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:27,723 DEBUG [Listener at jenkins-hbase20.apache.org/34497] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/export-test/export-1689232638262/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-13 07:17:27,723 DEBUG [Listener at jenkins-hbase20.apache.org/34497] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/export-test/export-1689232638262/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-13 07:17:27,729 INFO [Listener at jenkins-hbase20.apache.org/34497] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-07-13 07:17:27,729 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testtb-testEmptyExportFileSystemState 2023-07-13 07:17:27,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] procedure2.ProcedureExecutor(1029): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-13 07:17:27,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-13 07:17:27,733 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689232647733"}]},"ts":"1689232647733"} 2023-07-13 07:17:27,735 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-07-13 07:17:27,736 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-07-13 07:17:27,737 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=4fb92fbfea92a4cbee44dce153d0c4ea, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=e769c2959a441642d66d543a61b0eddc, UNASSIGN}] 2023-07-13 07:17:27,739 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=4fb92fbfea92a4cbee44dce153d0c4ea, UNASSIGN 2023-07-13 07:17:27,740 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=e769c2959a441642d66d543a61b0eddc, UNASSIGN 2023-07-13 07:17:27,741 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=e769c2959a441642d66d543a61b0eddc, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:17:27,741 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=4fb92fbfea92a4cbee44dce153d0c4ea, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:17:27,741 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689232635530.e769c2959a441642d66d543a61b0eddc.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689232647741"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689232647741"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689232647741"}]},"ts":"1689232647741"} 2023-07-13 07:17:27,741 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689232635530.4fb92fbfea92a4cbee44dce153d0c4ea.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689232647741"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689232647741"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689232647741"}]},"ts":"1689232647741"} 2023-07-13 07:17:27,743 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=101, state=RUNNABLE; CloseRegionProcedure e769c2959a441642d66d543a61b0eddc, server=jenkins-hbase20.apache.org,42807,1689232541407}] 2023-07-13 07:17:27,743 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=100, state=RUNNABLE; CloseRegionProcedure 4fb92fbfea92a4cbee44dce153d0c4ea, server=jenkins-hbase20.apache.org,44607,1689232541504}] 2023-07-13 07:17:27,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-13 07:17:27,895 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 4fb92fbfea92a4cbee44dce153d0c4ea 2023-07-13 07:17:27,895 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close e769c2959a441642d66d543a61b0eddc 2023-07-13 07:17:27,895 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 4fb92fbfea92a4cbee44dce153d0c4ea, disabling compactions & flushes 2023-07-13 07:17:27,895 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689232635530.4fb92fbfea92a4cbee44dce153d0c4ea. 2023-07-13 07:17:27,895 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing e769c2959a441642d66d543a61b0eddc, disabling compactions & flushes 2023-07-13 07:17:27,895 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689232635530.4fb92fbfea92a4cbee44dce153d0c4ea. 2023-07-13 07:17:27,895 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689232635530.4fb92fbfea92a4cbee44dce153d0c4ea. after waiting 0 ms 2023-07-13 07:17:27,895 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689232635530.4fb92fbfea92a4cbee44dce153d0c4ea. 2023-07-13 07:17:27,895 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689232635530.e769c2959a441642d66d543a61b0eddc. 2023-07-13 07:17:27,895 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689232635530.e769c2959a441642d66d543a61b0eddc. 2023-07-13 07:17:27,895 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689232635530.e769c2959a441642d66d543a61b0eddc. after waiting 0 ms 2023-07-13 07:17:27,895 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689232635530.e769c2959a441642d66d543a61b0eddc. 2023-07-13 07:17:27,929 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testEmptyExportFileSystemState/e769c2959a441642d66d543a61b0eddc/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-13 07:17:27,930 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-13 07:17:27,930 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testEmptyExportFileSystemState/4fb92fbfea92a4cbee44dce153d0c4ea/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-13 07:17:27,931 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689232635530.e769c2959a441642d66d543a61b0eddc. 2023-07-13 07:17:27,931 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for e769c2959a441642d66d543a61b0eddc: 2023-07-13 07:17:27,931 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-13 07:17:27,933 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689232635530.4fb92fbfea92a4cbee44dce153d0c4ea. 2023-07-13 07:17:27,933 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 4fb92fbfea92a4cbee44dce153d0c4ea: 2023-07-13 07:17:27,934 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed e769c2959a441642d66d543a61b0eddc 2023-07-13 07:17:27,934 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=e769c2959a441642d66d543a61b0eddc, regionState=CLOSED 2023-07-13 07:17:27,934 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 4fb92fbfea92a4cbee44dce153d0c4ea 2023-07-13 07:17:27,934 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689232635530.e769c2959a441642d66d543a61b0eddc.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689232647934"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689232647934"}]},"ts":"1689232647934"} 2023-07-13 07:17:27,935 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=4fb92fbfea92a4cbee44dce153d0c4ea, regionState=CLOSED 2023-07-13 07:17:27,935 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689232635530.4fb92fbfea92a4cbee44dce153d0c4ea.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689232647935"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689232647935"}]},"ts":"1689232647935"} 2023-07-13 07:17:27,938 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=101 2023-07-13 07:17:27,938 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=101, state=SUCCESS; CloseRegionProcedure e769c2959a441642d66d543a61b0eddc, server=jenkins-hbase20.apache.org,42807,1689232541407 in 193 msec 2023-07-13 07:17:27,939 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=e769c2959a441642d66d543a61b0eddc, UNASSIGN in 201 msec 2023-07-13 07:17:27,939 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=100 2023-07-13 07:17:27,939 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=100, state=SUCCESS; CloseRegionProcedure 4fb92fbfea92a4cbee44dce153d0c4ea, server=jenkins-hbase20.apache.org,44607,1689232541504 in 194 msec 2023-07-13 07:17:27,941 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=100, resume processing ppid=99 2023-07-13 07:17:27,941 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=4fb92fbfea92a4cbee44dce153d0c4ea, UNASSIGN in 202 msec 2023-07-13 07:17:27,941 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689232647941"}]},"ts":"1689232647941"} 2023-07-13 07:17:27,942 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-07-13 07:17:27,946 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-07-13 07:17:27,948 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 218 msec 2023-07-13 07:17:28,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-13 07:17:28,038 INFO [Listener at jenkins-hbase20.apache.org/34497] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-07-13 07:17:28,039 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.HMaster$5(2228): Client=jenkins//148.251.75.209 delete testtb-testEmptyExportFileSystemState 2023-07-13 07:17:28,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-13 07:17:28,045 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-13 07:17:28,045 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-07-13 07:17:28,046 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-13 07:17:28,048 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44607] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-07-13 07:17:28,050 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-13 07:17:28,050 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-13 07:17:28,050 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-13 07:17:28,050 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-13 07:17:28,050 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-13 07:17:28,050 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-13 07:17:28,050 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-13 07:17:28,050 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-13 07:17:28,051 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-13 07:17:28,051 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-13 07:17:28,051 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-13 07:17:28,051 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 07:17:28,051 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 07:17:28,051 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-13 07:17:28,051 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 07:17:28,051 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 07:17:28,052 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-13 07:17:28,052 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testEmptyExportFileSystemState/4fb92fbfea92a4cbee44dce153d0c4ea 2023-07-13 07:17:28,052 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testEmptyExportFileSystemState/e769c2959a441642d66d543a61b0eddc 2023-07-13 07:17:28,055 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testEmptyExportFileSystemState/e769c2959a441642d66d543a61b0eddc/cf, FileablePath, hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testEmptyExportFileSystemState/e769c2959a441642d66d543a61b0eddc/recovered.edits] 2023-07-13 07:17:28,055 DEBUG [HFileArchiver-18] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testEmptyExportFileSystemState/4fb92fbfea92a4cbee44dce153d0c4ea/cf, FileablePath, hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testEmptyExportFileSystemState/4fb92fbfea92a4cbee44dce153d0c4ea/recovered.edits] 2023-07-13 07:17:28,060 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testEmptyExportFileSystemState/e769c2959a441642d66d543a61b0eddc/cf/8fe117f64b624d71b836cd939a370a0b to hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/archive/data/default/testtb-testEmptyExportFileSystemState/e769c2959a441642d66d543a61b0eddc/cf/8fe117f64b624d71b836cd939a370a0b 2023-07-13 07:17:28,060 DEBUG [HFileArchiver-18] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testEmptyExportFileSystemState/4fb92fbfea92a4cbee44dce153d0c4ea/cf/f184c33e8b4c4ff9bd459d0de16767ef to hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/archive/data/default/testtb-testEmptyExportFileSystemState/4fb92fbfea92a4cbee44dce153d0c4ea/cf/f184c33e8b4c4ff9bd459d0de16767ef 2023-07-13 07:17:28,064 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testEmptyExportFileSystemState/e769c2959a441642d66d543a61b0eddc/recovered.edits/9.seqid to hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/archive/data/default/testtb-testEmptyExportFileSystemState/e769c2959a441642d66d543a61b0eddc/recovered.edits/9.seqid 2023-07-13 07:17:28,064 DEBUG [HFileArchiver-18] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testEmptyExportFileSystemState/4fb92fbfea92a4cbee44dce153d0c4ea/recovered.edits/9.seqid to hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/archive/data/default/testtb-testEmptyExportFileSystemState/4fb92fbfea92a4cbee44dce153d0c4ea/recovered.edits/9.seqid 2023-07-13 07:17:28,064 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testEmptyExportFileSystemState/e769c2959a441642d66d543a61b0eddc 2023-07-13 07:17:28,064 DEBUG [HFileArchiver-18] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testEmptyExportFileSystemState/4fb92fbfea92a4cbee44dce153d0c4ea 2023-07-13 07:17:28,064 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-13 07:17:28,067 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-13 07:17:28,069 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-07-13 07:17:28,071 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-07-13 07:17:28,072 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-13 07:17:28,072 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-07-13 07:17:28,072 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1689232635530.4fb92fbfea92a4cbee44dce153d0c4ea.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689232648072"}]},"ts":"9223372036854775807"} 2023-07-13 07:17:28,073 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1689232635530.e769c2959a441642d66d543a61b0eddc.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689232648072"}]},"ts":"9223372036854775807"} 2023-07-13 07:17:28,075 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-13 07:17:28,075 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 4fb92fbfea92a4cbee44dce153d0c4ea, NAME => 'testtb-testEmptyExportFileSystemState,,1689232635530.4fb92fbfea92a4cbee44dce153d0c4ea.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => e769c2959a441642d66d543a61b0eddc, NAME => 'testtb-testEmptyExportFileSystemState,1,1689232635530.e769c2959a441642d66d543a61b0eddc.', STARTKEY => '1', ENDKEY => ''}] 2023-07-13 07:17:28,075 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-07-13 07:17:28,075 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689232648075"}]},"ts":"9223372036854775807"} 2023-07-13 07:17:28,077 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-07-13 07:17:28,078 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-13 07:17:28,079 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 38 msec 2023-07-13 07:17:28,153 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-13 07:17:28,154 INFO [Listener at jenkins-hbase20.apache.org/34497] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-07-13 07:17:28,164 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-07-13 07:17:28,167 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:28,169 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-07-13 07:17:28,172 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-07-13 07:17:28,204 INFO [Listener at jenkins-hbase20.apache.org/34497] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testEmptyExportFileSystemState Thread=763 (was 762) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_139625932_17 at /127.0.0.1:37564 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0xd7981d0-shared-pool-38 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0xd7981d0-shared-pool-37 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (788891943) connection to jenkins-hbase20.apache.org/148.251.75.209:38211 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0xd7981d0-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_139625932_17 at /127.0.0.1:36786 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (788891943) connection to jenkins-hbase20.apache.org/148.251.75.209:40813 from appattempt_1689232548306_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (788891943) connection to jenkins-hbase20.apache.org/148.251.75.209:35097 from appattempt_1689232548306_0005_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1262850338_1 at /127.0.0.1:38170 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_139625932_17 at /127.0.0.1:38220 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4830 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0xd7981d0-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=935 (was 916) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=509 (was 528), ProcessCount=170 (was 170), AvailableMemoryMB=2949 (was 3504) 2023-07-13 07:17:28,204 WARN [Listener at jenkins-hbase20.apache.org/34497] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-07-13 07:17:28,234 INFO [Listener at jenkins-hbase20.apache.org/34497] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=763, OpenFileDescriptor=935, MaxFileDescriptor=60000, SystemLoadAverage=509, ProcessCount=170, AvailableMemoryMB=2948 2023-07-13 07:17:28,234 WARN [Listener at jenkins-hbase20.apache.org/34497] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-07-13 07:17:28,236 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-13 07:17:28,237 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:28,240 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-07-13 07:17:28,241 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-07-13 07:17:28,242 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-13 07:17:28,243 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-13 07:17:28,247 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c4dddc8cbb0984cdfd6dfbaf671e8834 2023-07-13 07:17:28,247 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/b3b6fc2ea072cf4a8ce8c9b729845756 2023-07-13 07:17:28,248 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c4dddc8cbb0984cdfd6dfbaf671e8834 empty. 2023-07-13 07:17:28,248 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/b3b6fc2ea072cf4a8ce8c9b729845756 empty. 2023-07-13 07:17:28,249 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c4dddc8cbb0984cdfd6dfbaf671e8834 2023-07-13 07:17:28,249 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/b3b6fc2ea072cf4a8ce8c9b729845756 2023-07-13 07:17:28,249 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-13 07:17:28,270 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-07-13 07:17:28,272 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => c4dddc8cbb0984cdfd6dfbaf671e8834, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689232648236.c4dddc8cbb0984cdfd6dfbaf671e8834.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp 2023-07-13 07:17:28,272 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => b3b6fc2ea072cf4a8ce8c9b729845756, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689232648236.b3b6fc2ea072cf4a8ce8c9b729845756.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp 2023-07-13 07:17:28,311 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689232648236.c4dddc8cbb0984cdfd6dfbaf671e8834.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 07:17:28,311 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing c4dddc8cbb0984cdfd6dfbaf671e8834, disabling compactions & flushes 2023-07-13 07:17:28,312 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689232648236.c4dddc8cbb0984cdfd6dfbaf671e8834. 2023-07-13 07:17:28,312 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689232648236.c4dddc8cbb0984cdfd6dfbaf671e8834. 2023-07-13 07:17:28,312 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689232648236.c4dddc8cbb0984cdfd6dfbaf671e8834. after waiting 0 ms 2023-07-13 07:17:28,312 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689232648236.c4dddc8cbb0984cdfd6dfbaf671e8834. 2023-07-13 07:17:28,312 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689232648236.c4dddc8cbb0984cdfd6dfbaf671e8834. 2023-07-13 07:17:28,312 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for c4dddc8cbb0984cdfd6dfbaf671e8834: 2023-07-13 07:17:28,313 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689232648236.b3b6fc2ea072cf4a8ce8c9b729845756.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 07:17:28,313 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing b3b6fc2ea072cf4a8ce8c9b729845756, disabling compactions & flushes 2023-07-13 07:17:28,313 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689232648236.b3b6fc2ea072cf4a8ce8c9b729845756. 2023-07-13 07:17:28,313 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689232648236.b3b6fc2ea072cf4a8ce8c9b729845756. 2023-07-13 07:17:28,313 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689232648236.b3b6fc2ea072cf4a8ce8c9b729845756. after waiting 0 ms 2023-07-13 07:17:28,313 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689232648236.b3b6fc2ea072cf4a8ce8c9b729845756. 2023-07-13 07:17:28,313 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689232648236.b3b6fc2ea072cf4a8ce8c9b729845756. 2023-07-13 07:17:28,313 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for b3b6fc2ea072cf4a8ce8c9b729845756: 2023-07-13 07:17:28,315 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-07-13 07:17:28,316 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689232648236.c4dddc8cbb0984cdfd6dfbaf671e8834.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689232648315"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689232648315"}]},"ts":"1689232648315"} 2023-07-13 07:17:28,316 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689232648236.b3b6fc2ea072cf4a8ce8c9b729845756.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689232648315"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689232648315"}]},"ts":"1689232648315"} 2023-07-13 07:17:28,318 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-13 07:17:28,319 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-13 07:17:28,319 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689232648319"}]},"ts":"1689232648319"} 2023-07-13 07:17:28,320 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-07-13 07:17:28,322 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-07-13 07:17:28,324 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-13 07:17:28,324 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-13 07:17:28,324 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-13 07:17:28,324 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-13 07:17:28,324 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=b3b6fc2ea072cf4a8ce8c9b729845756, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=c4dddc8cbb0984cdfd6dfbaf671e8834, ASSIGN}] 2023-07-13 07:17:28,327 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=c4dddc8cbb0984cdfd6dfbaf671e8834, ASSIGN 2023-07-13 07:17:28,327 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=b3b6fc2ea072cf4a8ce8c9b729845756, ASSIGN 2023-07-13 07:17:28,328 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=c4dddc8cbb0984cdfd6dfbaf671e8834, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,44607,1689232541504; forceNewPlan=false, retain=false 2023-07-13 07:17:28,328 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=b3b6fc2ea072cf4a8ce8c9b729845756, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,42807,1689232541407; forceNewPlan=false, retain=false 2023-07-13 07:17:28,343 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-13 07:17:28,478 INFO [jenkins-hbase20:37475] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-13 07:17:28,481 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=c4dddc8cbb0984cdfd6dfbaf671e8834, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:17:28,481 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=b3b6fc2ea072cf4a8ce8c9b729845756, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:17:28,482 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689232648236.c4dddc8cbb0984cdfd6dfbaf671e8834.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689232648481"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689232648481"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689232648481"}]},"ts":"1689232648481"} 2023-07-13 07:17:28,482 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689232648236.b3b6fc2ea072cf4a8ce8c9b729845756.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689232648481"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689232648481"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689232648481"}]},"ts":"1689232648481"} 2023-07-13 07:17:28,483 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=108, ppid=107, state=RUNNABLE; OpenRegionProcedure c4dddc8cbb0984cdfd6dfbaf671e8834, server=jenkins-hbase20.apache.org,44607,1689232541504}] 2023-07-13 07:17:28,485 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=106, state=RUNNABLE; OpenRegionProcedure b3b6fc2ea072cf4a8ce8c9b729845756, server=jenkins-hbase20.apache.org,42807,1689232541407}] 2023-07-13 07:17:28,544 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-13 07:17:28,638 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1689232648236.c4dddc8cbb0984cdfd6dfbaf671e8834. 2023-07-13 07:17:28,638 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c4dddc8cbb0984cdfd6dfbaf671e8834, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689232648236.c4dddc8cbb0984cdfd6dfbaf671e8834.', STARTKEY => '1', ENDKEY => ''} 2023-07-13 07:17:28,639 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1689232648236.c4dddc8cbb0984cdfd6dfbaf671e8834. service=AccessControlService 2023-07-13 07:17:28,639 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-13 07:17:28,639 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp c4dddc8cbb0984cdfd6dfbaf671e8834 2023-07-13 07:17:28,639 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689232648236.c4dddc8cbb0984cdfd6dfbaf671e8834.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 07:17:28,639 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for c4dddc8cbb0984cdfd6dfbaf671e8834 2023-07-13 07:17:28,639 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for c4dddc8cbb0984cdfd6dfbaf671e8834 2023-07-13 07:17:28,640 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1689232648236.b3b6fc2ea072cf4a8ce8c9b729845756. 2023-07-13 07:17:28,640 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b3b6fc2ea072cf4a8ce8c9b729845756, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689232648236.b3b6fc2ea072cf4a8ce8c9b729845756.', STARTKEY => '', ENDKEY => '1'} 2023-07-13 07:17:28,640 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1689232648236.b3b6fc2ea072cf4a8ce8c9b729845756. service=AccessControlService 2023-07-13 07:17:28,640 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-13 07:17:28,640 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp b3b6fc2ea072cf4a8ce8c9b729845756 2023-07-13 07:17:28,641 INFO [StoreOpener-c4dddc8cbb0984cdfd6dfbaf671e8834-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region c4dddc8cbb0984cdfd6dfbaf671e8834 2023-07-13 07:17:28,641 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689232648236.b3b6fc2ea072cf4a8ce8c9b729845756.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 07:17:28,641 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for b3b6fc2ea072cf4a8ce8c9b729845756 2023-07-13 07:17:28,641 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for b3b6fc2ea072cf4a8ce8c9b729845756 2023-07-13 07:17:28,642 INFO [StoreOpener-b3b6fc2ea072cf4a8ce8c9b729845756-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region b3b6fc2ea072cf4a8ce8c9b729845756 2023-07-13 07:17:28,642 DEBUG [StoreOpener-c4dddc8cbb0984cdfd6dfbaf671e8834-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testExportFileSystemStateWithSkipTmp/c4dddc8cbb0984cdfd6dfbaf671e8834/cf 2023-07-13 07:17:28,642 DEBUG [StoreOpener-c4dddc8cbb0984cdfd6dfbaf671e8834-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testExportFileSystemStateWithSkipTmp/c4dddc8cbb0984cdfd6dfbaf671e8834/cf 2023-07-13 07:17:28,643 INFO [StoreOpener-c4dddc8cbb0984cdfd6dfbaf671e8834-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c4dddc8cbb0984cdfd6dfbaf671e8834 columnFamilyName cf 2023-07-13 07:17:28,644 INFO [StoreOpener-c4dddc8cbb0984cdfd6dfbaf671e8834-1] regionserver.HStore(310): Store=c4dddc8cbb0984cdfd6dfbaf671e8834/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-13 07:17:28,644 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testExportFileSystemStateWithSkipTmp/c4dddc8cbb0984cdfd6dfbaf671e8834 2023-07-13 07:17:28,645 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testExportFileSystemStateWithSkipTmp/c4dddc8cbb0984cdfd6dfbaf671e8834 2023-07-13 07:17:28,646 DEBUG [StoreOpener-b3b6fc2ea072cf4a8ce8c9b729845756-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testExportFileSystemStateWithSkipTmp/b3b6fc2ea072cf4a8ce8c9b729845756/cf 2023-07-13 07:17:28,646 DEBUG [StoreOpener-b3b6fc2ea072cf4a8ce8c9b729845756-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testExportFileSystemStateWithSkipTmp/b3b6fc2ea072cf4a8ce8c9b729845756/cf 2023-07-13 07:17:28,647 INFO [StoreOpener-b3b6fc2ea072cf4a8ce8c9b729845756-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b3b6fc2ea072cf4a8ce8c9b729845756 columnFamilyName cf 2023-07-13 07:17:28,647 INFO [StoreOpener-b3b6fc2ea072cf4a8ce8c9b729845756-1] regionserver.HStore(310): Store=b3b6fc2ea072cf4a8ce8c9b729845756/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-13 07:17:28,647 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for c4dddc8cbb0984cdfd6dfbaf671e8834 2023-07-13 07:17:28,648 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testExportFileSystemStateWithSkipTmp/b3b6fc2ea072cf4a8ce8c9b729845756 2023-07-13 07:17:28,648 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testExportFileSystemStateWithSkipTmp/b3b6fc2ea072cf4a8ce8c9b729845756 2023-07-13 07:17:28,649 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testExportFileSystemStateWithSkipTmp/c4dddc8cbb0984cdfd6dfbaf671e8834/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-13 07:17:28,650 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened c4dddc8cbb0984cdfd6dfbaf671e8834; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64291148, jitterRate=-0.04198724031448364}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-13 07:17:28,650 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for c4dddc8cbb0984cdfd6dfbaf671e8834: 2023-07-13 07:17:28,650 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1689232648236.c4dddc8cbb0984cdfd6dfbaf671e8834., pid=108, masterSystemTime=1689232648635 2023-07-13 07:17:28,651 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for b3b6fc2ea072cf4a8ce8c9b729845756 2023-07-13 07:17:28,652 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1689232648236.c4dddc8cbb0984cdfd6dfbaf671e8834. 2023-07-13 07:17:28,652 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1689232648236.c4dddc8cbb0984cdfd6dfbaf671e8834. 2023-07-13 07:17:28,653 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=c4dddc8cbb0984cdfd6dfbaf671e8834, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:17:28,653 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689232648236.c4dddc8cbb0984cdfd6dfbaf671e8834.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689232648653"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689232648653"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689232648653"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689232648653"}]},"ts":"1689232648653"} 2023-07-13 07:17:28,654 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testExportFileSystemStateWithSkipTmp/b3b6fc2ea072cf4a8ce8c9b729845756/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-13 07:17:28,655 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened b3b6fc2ea072cf4a8ce8c9b729845756; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74187741, jitterRate=0.10548348724842072}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-13 07:17:28,655 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for b3b6fc2ea072cf4a8ce8c9b729845756: 2023-07-13 07:17:28,656 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1689232648236.b3b6fc2ea072cf4a8ce8c9b729845756., pid=109, masterSystemTime=1689232648637 2023-07-13 07:17:28,656 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=108, resume processing ppid=107 2023-07-13 07:17:28,656 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=107, state=SUCCESS; OpenRegionProcedure c4dddc8cbb0984cdfd6dfbaf671e8834, server=jenkins-hbase20.apache.org,44607,1689232541504 in 172 msec 2023-07-13 07:17:28,657 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1689232648236.b3b6fc2ea072cf4a8ce8c9b729845756. 2023-07-13 07:17:28,657 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1689232648236.b3b6fc2ea072cf4a8ce8c9b729845756. 2023-07-13 07:17:28,657 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=c4dddc8cbb0984cdfd6dfbaf671e8834, ASSIGN in 332 msec 2023-07-13 07:17:28,658 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=b3b6fc2ea072cf4a8ce8c9b729845756, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:17:28,658 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689232648236.b3b6fc2ea072cf4a8ce8c9b729845756.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689232648658"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689232648658"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689232648658"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689232648658"}]},"ts":"1689232648658"} 2023-07-13 07:17:28,660 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=106 2023-07-13 07:17:28,660 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=106, state=SUCCESS; OpenRegionProcedure b3b6fc2ea072cf4a8ce8c9b729845756, server=jenkins-hbase20.apache.org,42807,1689232541407 in 174 msec 2023-07-13 07:17:28,662 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=106, resume processing ppid=105 2023-07-13 07:17:28,662 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=b3b6fc2ea072cf4a8ce8c9b729845756, ASSIGN in 337 msec 2023-07-13 07:17:28,663 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-13 07:17:28,663 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689232648663"}]},"ts":"1689232648663"} 2023-07-13 07:17:28,664 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-07-13 07:17:28,666 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-07-13 07:17:28,666 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-07-13 07:17:28,668 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44607] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-13 07:17:28,669 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 07:17:28,669 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 07:17:28,669 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 07:17:28,670 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-13 07:17:28,670 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-13 07:17:28,670 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-13 07:17:28,672 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 434 msec 2023-07-13 07:17:28,674 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 07:17:28,674 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-13 07:17:28,846 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-13 07:17:28,846 INFO [Listener at jenkins-hbase20.apache.org/34497] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-07-13 07:17:28,846 DEBUG [Listener at jenkins-hbase20.apache.org/34497] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemStateWithSkipTmp get assigned. Timeout = 60000ms 2023-07-13 07:17:28,846 INFO [Listener at jenkins-hbase20.apache.org/34497] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-13 07:17:28,850 INFO [Listener at jenkins-hbase20.apache.org/34497] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemStateWithSkipTmp assigned to meta. Checking AM states. 2023-07-13 07:17:28,851 INFO [Listener at jenkins-hbase20.apache.org/34497] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-13 07:17:28,851 INFO [Listener at jenkins-hbase20.apache.org/34497] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemStateWithSkipTmp assigned. 2023-07-13 07:17:28,855 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-13 07:17:28,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689232648855 (current time:1689232648855). 2023-07-13 07:17:28,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-13 07:17:28,856 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] zookeeper.ReadOnlyZKClient(139): Connect 0x011a68f1 to 127.0.0.1:58099 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-13 07:17:28,875 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2ecfbb21, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-13 07:17:28,876 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 07:17:28,885 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:57538, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 07:17:28,887 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x011a68f1 to 127.0.0.1:58099 2023-07-13 07:17:28,887 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 07:17:28,887 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] zookeeper.ReadOnlyZKClient(139): Connect 0x0c5dd756 to 127.0.0.1:58099 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-13 07:17:28,896 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5ed27bcc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-13 07:17:28,897 DEBUG [hconnection-0xd17d584-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 07:17:28,900 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:57540, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 07:17:28,904 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 07:17:28,907 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:51782, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 07:17:28,908 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0c5dd756 to 127.0.0.1:58099 2023-07-13 07:17:28,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 07:17:28,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-13 07:17:28,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-13 07:17:28,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-13 07:17:28,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] procedure2.ProcedureExecutor(1029): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-13 07:17:28,913 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-13 07:17:28,913 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689233248913 2023-07-13 07:17:28,913 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:28,913 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-13 07:17:28,915 DEBUG [Listener at jenkins-hbase20.apache.org/34497] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-13 07:17:28,916 DEBUG [Listener at jenkins-hbase20.apache.org/34497] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-13 07:17:28,916 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1029): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-13 07:17:28,917 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-13 07:17:28,918 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 6 msec 2023-07-13 07:17:28,920 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-13 07:17:28,921 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689233248921 2023-07-13 07:17:28,932 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:28,932 INFO [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-13 07:17:28,932 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 07:17:28,933 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-13 07:17:28,933 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-13 07:17:28,934 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:28,934 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:28,935 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:17:28,935 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:17:28,935 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:17:28,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:17:28,935 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:17:28,935 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:17:28,936 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:17:28,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:17:28,936 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:17:28,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:28,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:17:28,936 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:17:28,936 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:17:28,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:28,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:28,936 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:17:28,936 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-13 07:17:28,936 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:28,936 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:28,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-13 07:17:28,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:28,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-13 07:17:28,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:28,937 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-13 07:17:28,937 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-13 07:17:28,937 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:28,937 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:28,937 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-13 07:17:28,937 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 07:17:28,937 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:28,939 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-13 07:17:28,939 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-13 07:17:28,939 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44607,1689232541504' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-13 07:17:28,937 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-13 07:17:28,939 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 07:17:28,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-13 07:17:28,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:28,940 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-13 07:17:28,941 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-13 07:17:28,941 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,42807,1689232541407' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-13 07:17:28,941 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-13 07:17:28,941 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:28,941 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-13 07:17:28,941 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 07:17:28,942 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-13 07:17:28,942 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-13 07:17:28,942 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44195,1689232541463' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-13 07:17:28,944 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:17:28,944 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:28,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:17:28,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 07:17:28,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 07:17:28,945 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:17:28,945 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:28,945 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:28,945 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 07:17:28,945 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:28,945 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:28,945 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 07:17:28,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 07:17:28,946 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:28,946 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 07:17:28,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 07:17:28,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:28,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:17:28,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:17:28,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:17:28,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 07:17:28,947 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44607,1689232541504' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-13 07:17:28,947 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7b1015b3[Count = 1] remaining members to acquire global barrier 2023-07-13 07:17:28,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:17:28,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 07:17:28,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 07:17:28,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 07:17:28,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 07:17:28,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:28,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:17:28,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:17:28,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:17:28,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 07:17:28,948 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,42807,1689232541407' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-13 07:17:28,948 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7b1015b3[Count = 0] remaining members to acquire global barrier 2023-07-13 07:17:28,948 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-13 07:17:28,948 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:28,949 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:28,949 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:28,949 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:28,949 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:28,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:28,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:28,949 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:28,949 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-13 07:17:28,949 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:28,949 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-13 07:17:28,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:28,949 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:17:28,949 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-13 07:17:28,949 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-13 07:17:28,949 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-13 07:17:28,949 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-13 07:17:28,949 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-13 07:17:28,949 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-13 07:17:28,949 DEBUG [rs(jenkins-hbase20.apache.org,44607,1689232541504)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689232648236.c4dddc8cbb0984cdfd6dfbaf671e8834. 2023-07-13 07:17:28,949 DEBUG [rs(jenkins-hbase20.apache.org,42807,1689232541407)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689232648236.b3b6fc2ea072cf4a8ce8c9b729845756. 2023-07-13 07:17:28,949 DEBUG [rs(jenkins-hbase20.apache.org,44607,1689232541504)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689232648236.c4dddc8cbb0984cdfd6dfbaf671e8834. started... 2023-07-13 07:17:28,949 DEBUG [rs(jenkins-hbase20.apache.org,42807,1689232541407)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689232648236.b3b6fc2ea072cf4a8ce8c9b729845756. started... 2023-07-13 07:17:28,949 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase20.apache.org,44195,1689232541463' in zk 2023-07-13 07:17:28,949 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:17:28,951 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-13 07:17:28,951 DEBUG [rs(jenkins-hbase20.apache.org,44607,1689232541504)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c4dddc8cbb0984cdfd6dfbaf671e8834: 2023-07-13 07:17:28,951 DEBUG [rs(jenkins-hbase20.apache.org,42807,1689232541407)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b3b6fc2ea072cf4a8ce8c9b729845756: 2023-07-13 07:17:28,951 DEBUG [rs(jenkins-hbase20.apache.org,44607,1689232541504)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689232648236.c4dddc8cbb0984cdfd6dfbaf671e8834.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:28,951 DEBUG [rs(jenkins-hbase20.apache.org,42807,1689232541407)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689232648236.b3b6fc2ea072cf4a8ce8c9b729845756.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:28,951 DEBUG [rs(jenkins-hbase20.apache.org,44607,1689232541504)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-13 07:17:28,951 DEBUG [rs(jenkins-hbase20.apache.org,42807,1689232541407)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-13 07:17:28,951 DEBUG [rs(jenkins-hbase20.apache.org,44607,1689232541504)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-13 07:17:28,951 DEBUG [rs(jenkins-hbase20.apache.org,42807,1689232541407)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-13 07:17:28,952 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-13 07:17:28,952 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 07:17:28,952 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-13 07:17:28,965 DEBUG [rs(jenkins-hbase20.apache.org,42807,1689232541407)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689232648236.b3b6fc2ea072cf4a8ce8c9b729845756. completed. 2023-07-13 07:17:28,965 DEBUG [rs(jenkins-hbase20.apache.org,42807,1689232541407)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689232648236.b3b6fc2ea072cf4a8ce8c9b729845756. 2023-07-13 07:17:28,965 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-13 07:17:28,965 DEBUG [rs(jenkins-hbase20.apache.org,44607,1689232541504)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689232648236.c4dddc8cbb0984cdfd6dfbaf671e8834. completed. 2023-07-13 07:17:28,965 DEBUG [rs(jenkins-hbase20.apache.org,44607,1689232541504)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689232648236.c4dddc8cbb0984cdfd6dfbaf671e8834. 2023-07-13 07:17:28,965 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-13 07:17:28,965 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-13 07:17:28,965 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-13 07:17:28,965 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:17:28,965 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:17:28,965 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-13 07:17:28,966 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-13 07:17:28,966 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase20.apache.org,44607,1689232541504' in zk 2023-07-13 07:17:28,966 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase20.apache.org,42807,1689232541407' in zk 2023-07-13 07:17:28,974 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-13 07:17:28,974 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-13 07:17:28,974 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:17:28,974 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 07:17:28,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:17:28,974 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-13 07:17:28,974 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 07:17:28,976 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-13 07:17:28,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 07:17:28,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 07:17:28,974 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:17:28,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 07:17:28,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 07:17:28,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:28,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:17:28,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:17:28,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:17:28,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 07:17:28,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:28,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:17:28,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:17:28,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:17:28,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase20.apache.org,44607,1689232541504': 2023-07-13 07:17:28,979 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44607,1689232541504' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-13 07:17:28,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:17:28,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 07:17:28,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 07:17:28,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 07:17:28,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 07:17:28,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:28,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:17:28,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:17:28,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:17:28,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 07:17:28,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:28,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:17:28,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:17:28,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:17:28,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase20.apache.org,42807,1689232541407': 2023-07-13 07:17:28,982 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,42807,1689232541407' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-13 07:17:28,982 INFO [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-13 07:17:28,982 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-13 07:17:28,982 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-13 07:17:28,982 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:28,982 INFO [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-13 07:17:28,986 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:28,986 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:28,986 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:28,986 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:28,986 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:28,986 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:17:28,987 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:28,987 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:17:28,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:28,987 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:17:28,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:28,986 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:17:28,986 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:28,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 07:17:28,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 07:17:28,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:28,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:28,987 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:17:28,987 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:17:28,987 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:17:28,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:17:28,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 07:17:28,987 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:17:28,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:17:28,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:17:28,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:28,988 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:17:28,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:28,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:28,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:28,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 07:17:28,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:28,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:17:28,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:17:28,989 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:17:28,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:17:28,989 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:17:28,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 07:17:28,990 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:17:28,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:28,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:17:28,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:17:28,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:17:28,999 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:17:28,999 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:17:28,999 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:17:28,999 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:28,999 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:17:29,000 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:17:29,000 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:29,000 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:17:29,000 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:29,000 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:17:29,000 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:17:29,000 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:29,000 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:28,999 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:17:29,000 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:29,000 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 07:17:28,999 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:17:28,999 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:17:28,999 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:17:28,999 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:17:29,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:17:29,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:17:29,000 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:29,000 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:17:29,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:17:29,000 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:17:29,002 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:17:29,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:17:29,002 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:17:29,002 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:17:29,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:17:29,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:17:29,002 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:29,016 DEBUG [Listener at jenkins-hbase20.apache.org/34497] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 07:17:29,017 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-13 07:17:29,017 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-13 07:17:29,017 DEBUG [Listener at jenkins-hbase20.apache.org/34497] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-13 07:17:29,027 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:29,053 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-13 07:17:29,053 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:29,054 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:29,054 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689232648914Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689232649000 (+86 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689232649002 (+2 ms)Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689232649005 (+3 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689232649022 (+17 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689232649053 (+31 ms) 2023-07-13 07:17:29,056 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-13 07:17:29,058 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 142 msec 2023-07-13 07:17:29,218 DEBUG [Listener at jenkins-hbase20.apache.org/34497] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 07:17:29,218 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-13 07:17:29,219 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-13 07:17:29,227 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42807] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1689232648236.b3b6fc2ea072cf4a8ce8c9b729845756. with WAL disabled. Data may be lost in the event of a crash. 2023-07-13 07:17:29,228 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44607] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1689232648236.c4dddc8cbb0984cdfd6dfbaf671e8834. with WAL disabled. Data may be lost in the event of a crash. 2023-07-13 07:17:29,233 DEBUG [Listener at jenkins-hbase20.apache.org/34497] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:29,234 DEBUG [Listener at jenkins-hbase20.apache.org/34497] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1689232648236.b3b6fc2ea072cf4a8ce8c9b729845756. 2023-07-13 07:17:29,234 INFO [Listener at jenkins-hbase20.apache.org/34497] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-13 07:17:29,247 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-13 07:17:29,248 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689232649248 (current time:1689232649248). 2023-07-13 07:17:29,248 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-13 07:17:29,248 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] zookeeper.ReadOnlyZKClient(139): Connect 0x144ff7c4 to 127.0.0.1:58099 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-13 07:17:29,254 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@27c7ab3c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-13 07:17:29,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 07:17:29,257 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:57550, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 07:17:29,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x144ff7c4 to 127.0.0.1:58099 2023-07-13 07:17:29,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 07:17:29,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] zookeeper.ReadOnlyZKClient(139): Connect 0x69361f6a to 127.0.0.1:58099 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-13 07:17:29,279 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@22c245f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-13 07:17:29,281 DEBUG [hconnection-0x1828f16d-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 07:17:29,285 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:57554, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 07:17:29,292 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 07:17:29,299 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:51792, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 07:17:29,300 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x69361f6a to 127.0.0.1:58099 2023-07-13 07:17:29,301 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 07:17:29,301 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-13 07:17:29,302 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-13 07:17:29,302 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-13 07:17:29,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-13 07:17:29,308 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-13 07:17:29,309 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689233249309 2023-07-13 07:17:29,309 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:29,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-13 07:17:29,311 DEBUG [Listener at jenkins-hbase20.apache.org/34497] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-13 07:17:29,311 DEBUG [Listener at jenkins-hbase20.apache.org/34497] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-13 07:17:29,312 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1029): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-13 07:17:29,313 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-13 07:17:29,314 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 10 msec 2023-07-13 07:17:29,316 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-13 07:17:29,317 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689233249317 2023-07-13 07:17:29,328 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:29,328 INFO [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-13 07:17:29,328 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 07:17:29,330 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-13 07:17:29,330 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-13 07:17:29,330 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:29,330 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:29,331 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:17:29,331 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:17:29,331 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:17:29,331 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:17:29,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:17:29,332 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:17:29,332 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:17:29,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:17:29,332 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:17:29,333 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:17:29,333 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:17:29,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:17:29,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:29,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:29,334 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:17:29,334 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-13 07:17:29,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:29,335 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:29,335 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:29,335 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:29,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-13 07:17:29,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-13 07:17:29,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:29,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:29,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-13 07:17:29,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:29,335 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-13 07:17:29,335 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-13 07:17:29,335 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-13 07:17:29,335 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:29,335 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:29,335 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-13 07:17:29,336 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-13 07:17:29,336 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 07:17:29,335 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:29,337 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-13 07:17:29,337 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-13 07:17:29,337 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 07:17:29,336 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 07:17:29,339 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-13 07:17:29,340 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-13 07:17:29,340 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-13 07:17:29,337 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-13 07:17:29,340 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44607,1689232541504' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-13 07:17:29,340 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-13 07:17:29,341 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,42807,1689232541407' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-13 07:17:29,340 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44195,1689232541463' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-13 07:17:29,349 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:17:29,349 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:29,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:17:29,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 07:17:29,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 07:17:29,355 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:17:29,355 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:29,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 07:17:29,355 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:29,355 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 07:17:29,355 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:29,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 07:17:29,355 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:29,356 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 07:17:29,356 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:29,356 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 07:17:29,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:29,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:17:29,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:17:29,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:17:29,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 07:17:29,357 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,42807,1689232541407' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-13 07:17:29,357 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6c5ff29d[Count = 1] remaining members to acquire global barrier 2023-07-13 07:17:29,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:17:29,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 07:17:29,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 07:17:29,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 07:17:29,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 07:17:29,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:29,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:17:29,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:17:29,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:17:29,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 07:17:29,361 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44607,1689232541504' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-13 07:17:29,361 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6c5ff29d[Count = 0] remaining members to acquire global barrier 2023-07-13 07:17:29,361 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-13 07:17:29,361 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:29,366 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:29,366 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:29,366 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:29,366 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:29,366 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:29,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:29,366 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:29,366 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-13 07:17:29,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:29,366 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:17:29,366 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-13 07:17:29,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:29,366 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-13 07:17:29,366 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-13 07:17:29,366 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-13 07:17:29,366 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-13 07:17:29,366 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase20.apache.org,44195,1689232541463' in zk 2023-07-13 07:17:29,366 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-13 07:17:29,367 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-13 07:17:29,367 DEBUG [rs(jenkins-hbase20.apache.org,42807,1689232541407)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689232648236.b3b6fc2ea072cf4a8ce8c9b729845756. 2023-07-13 07:17:29,366 DEBUG [rs(jenkins-hbase20.apache.org,44607,1689232541504)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689232648236.c4dddc8cbb0984cdfd6dfbaf671e8834. 2023-07-13 07:17:29,367 DEBUG [rs(jenkins-hbase20.apache.org,42807,1689232541407)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689232648236.b3b6fc2ea072cf4a8ce8c9b729845756. started... 2023-07-13 07:17:29,367 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:17:29,367 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-13 07:17:29,367 DEBUG [rs(jenkins-hbase20.apache.org,44607,1689232541504)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689232648236.c4dddc8cbb0984cdfd6dfbaf671e8834. started... 2023-07-13 07:17:29,367 INFO [rs(jenkins-hbase20.apache.org,42807,1689232541407)-snapshot-pool-0] regionserver.HRegion(2745): Flushing b3b6fc2ea072cf4a8ce8c9b729845756 1/1 column families, dataSize=65 B heapSize=400 B 2023-07-13 07:17:29,367 INFO [rs(jenkins-hbase20.apache.org,44607,1689232541504)-snapshot-pool-0] regionserver.HRegion(2745): Flushing c4dddc8cbb0984cdfd6dfbaf671e8834 1/1 column families, dataSize=3.19 KB heapSize=7.14 KB 2023-07-13 07:17:29,367 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-13 07:17:29,368 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 07:17:29,368 DEBUG [member: 'jenkins-hbase20.apache.org,44195,1689232541463' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-13 07:17:29,380 INFO [rs(jenkins-hbase20.apache.org,44607,1689232541504)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.19 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testExportFileSystemStateWithSkipTmp/c4dddc8cbb0984cdfd6dfbaf671e8834/.tmp/cf/c512df41c7c442eaaea74d225cc2648a 2023-07-13 07:17:29,380 INFO [rs(jenkins-hbase20.apache.org,42807,1689232541407)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=65 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testExportFileSystemStateWithSkipTmp/b3b6fc2ea072cf4a8ce8c9b729845756/.tmp/cf/c55ec2e934de4649b9511b6c1e0e28a8 2023-07-13 07:17:29,385 DEBUG [rs(jenkins-hbase20.apache.org,42807,1689232541407)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testExportFileSystemStateWithSkipTmp/b3b6fc2ea072cf4a8ce8c9b729845756/.tmp/cf/c55ec2e934de4649b9511b6c1e0e28a8 as hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testExportFileSystemStateWithSkipTmp/b3b6fc2ea072cf4a8ce8c9b729845756/cf/c55ec2e934de4649b9511b6c1e0e28a8 2023-07-13 07:17:29,385 DEBUG [rs(jenkins-hbase20.apache.org,44607,1689232541504)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testExportFileSystemStateWithSkipTmp/c4dddc8cbb0984cdfd6dfbaf671e8834/.tmp/cf/c512df41c7c442eaaea74d225cc2648a as hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testExportFileSystemStateWithSkipTmp/c4dddc8cbb0984cdfd6dfbaf671e8834/cf/c512df41c7c442eaaea74d225cc2648a 2023-07-13 07:17:29,390 INFO [rs(jenkins-hbase20.apache.org,42807,1689232541407)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testExportFileSystemStateWithSkipTmp/b3b6fc2ea072cf4a8ce8c9b729845756/cf/c55ec2e934de4649b9511b6c1e0e28a8, entries=1, sequenceid=6, filesize=4.9 K 2023-07-13 07:17:29,391 INFO [rs(jenkins-hbase20.apache.org,42807,1689232541407)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~65 B/65, heapSize ~384 B/384, currentSize=0 B/0 for b3b6fc2ea072cf4a8ce8c9b729845756 in 24ms, sequenceid=6, compaction requested=false 2023-07-13 07:17:29,391 DEBUG [rs(jenkins-hbase20.apache.org,42807,1689232541407)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-07-13 07:17:29,392 DEBUG [rs(jenkins-hbase20.apache.org,42807,1689232541407)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b3b6fc2ea072cf4a8ce8c9b729845756: 2023-07-13 07:17:29,392 DEBUG [rs(jenkins-hbase20.apache.org,42807,1689232541407)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689232648236.b3b6fc2ea072cf4a8ce8c9b729845756.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:29,392 DEBUG [rs(jenkins-hbase20.apache.org,42807,1689232541407)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-13 07:17:29,392 DEBUG [rs(jenkins-hbase20.apache.org,42807,1689232541407)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testExportFileSystemStateWithSkipTmp/b3b6fc2ea072cf4a8ce8c9b729845756/cf/c55ec2e934de4649b9511b6c1e0e28a8] hfiles 2023-07-13 07:17:29,392 DEBUG [rs(jenkins-hbase20.apache.org,42807,1689232541407)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testExportFileSystemStateWithSkipTmp/b3b6fc2ea072cf4a8ce8c9b729845756/cf/c55ec2e934de4649b9511b6c1e0e28a8 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:29,397 INFO [rs(jenkins-hbase20.apache.org,44607,1689232541504)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testExportFileSystemStateWithSkipTmp/c4dddc8cbb0984cdfd6dfbaf671e8834/cf/c512df41c7c442eaaea74d225cc2648a, entries=49, sequenceid=6, filesize=8.1 K 2023-07-13 07:17:29,398 INFO [rs(jenkins-hbase20.apache.org,44607,1689232541504)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.19 KB/3271, heapSize ~7.13 KB/7296, currentSize=0 B/0 for c4dddc8cbb0984cdfd6dfbaf671e8834 in 31ms, sequenceid=6, compaction requested=false 2023-07-13 07:17:29,412 DEBUG [Listener at jenkins-hbase20.apache.org/34497] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 07:17:29,412 DEBUG [rs(jenkins-hbase20.apache.org,44607,1689232541504)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c4dddc8cbb0984cdfd6dfbaf671e8834: 2023-07-13 07:17:29,412 DEBUG [rs(jenkins-hbase20.apache.org,44607,1689232541504)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689232648236.c4dddc8cbb0984cdfd6dfbaf671e8834.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:29,413 DEBUG [rs(jenkins-hbase20.apache.org,44607,1689232541504)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-13 07:17:29,413 DEBUG [rs(jenkins-hbase20.apache.org,44607,1689232541504)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testExportFileSystemStateWithSkipTmp/c4dddc8cbb0984cdfd6dfbaf671e8834/cf/c512df41c7c442eaaea74d225cc2648a] hfiles 2023-07-13 07:17:29,413 DEBUG [rs(jenkins-hbase20.apache.org,44607,1689232541504)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testExportFileSystemStateWithSkipTmp/c4dddc8cbb0984cdfd6dfbaf671e8834/cf/c512df41c7c442eaaea74d225cc2648a for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:29,413 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-13 07:17:29,413 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-13 07:17:29,413 DEBUG [Listener at jenkins-hbase20.apache.org/34497] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-13 07:17:29,417 DEBUG [rs(jenkins-hbase20.apache.org,42807,1689232541407)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689232648236.b3b6fc2ea072cf4a8ce8c9b729845756. completed. 2023-07-13 07:17:29,417 DEBUG [rs(jenkins-hbase20.apache.org,42807,1689232541407)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689232648236.b3b6fc2ea072cf4a8ce8c9b729845756. 2023-07-13 07:17:29,417 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-13 07:17:29,417 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-13 07:17:29,417 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:17:29,418 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-13 07:17:29,418 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase20.apache.org,42807,1689232541407' in zk 2023-07-13 07:17:29,419 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:17:29,419 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-13 07:17:29,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:17:29,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 07:17:29,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 07:17:29,419 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 07:17:29,419 DEBUG [member: 'jenkins-hbase20.apache.org,42807,1689232541407' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-13 07:17:29,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 07:17:29,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 07:17:29,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:29,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:17:29,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:17:29,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:17:29,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 07:17:29,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:29,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:17:29,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:17:29,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase20.apache.org,42807,1689232541407': 2023-07-13 07:17:29,422 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,42807,1689232541407' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-13 07:17:29,438 DEBUG [rs(jenkins-hbase20.apache.org,44607,1689232541504)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689232648236.c4dddc8cbb0984cdfd6dfbaf671e8834. completed. 2023-07-13 07:17:29,438 DEBUG [rs(jenkins-hbase20.apache.org,44607,1689232541504)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689232648236.c4dddc8cbb0984cdfd6dfbaf671e8834. 2023-07-13 07:17:29,438 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-13 07:17:29,438 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-13 07:17:29,438 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:17:29,438 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-13 07:17:29,438 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase20.apache.org,44607,1689232541504' in zk 2023-07-13 07:17:29,439 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-13 07:17:29,439 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:17:29,439 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 07:17:29,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:17:29,439 DEBUG [member: 'jenkins-hbase20.apache.org,44607,1689232541504' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-13 07:17:29,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 07:17:29,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 07:17:29,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 07:17:29,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 07:17:29,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:29,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:17:29,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:17:29,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:17:29,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 07:17:29,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:29,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:17:29,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:17:29,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:17:29,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase20.apache.org,44607,1689232541504': 2023-07-13 07:17:29,453 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44607,1689232541504' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-13 07:17:29,453 INFO [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-13 07:17:29,454 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-13 07:17:29,454 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-13 07:17:29,454 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:29,454 INFO [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-13 07:17:29,455 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:29,455 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:29,455 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:29,455 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:17:29,455 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:29,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:29,455 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:29,455 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:17:29,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:29,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:29,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 07:17:29,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 07:17:29,456 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:29,456 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:17:29,456 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:29,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:29,456 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:17:29,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:17:29,456 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:17:29,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:17:29,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 07:17:29,457 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:17:29,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:17:29,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:29,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:29,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:29,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:29,457 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:17:29,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 07:17:29,458 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:17:29,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:29,459 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:17:29,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:17:29,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:17:29,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:17:29,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 07:17:29,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:29,463 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:17:29,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:17:29,464 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:17:29,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:17:29,464 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:17:29,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:17:29,470 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:17:29,470 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:17:29,470 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:17:29,470 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:17:29,470 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:17:29,470 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:17:29,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:17:29,470 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:17:29,470 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:17:29,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:17:29,470 DEBUG [(jenkins-hbase20.apache.org,37475,1689232540263)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 07:17:29,470 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:17:29,470 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:29,471 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:29,471 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:17:29,471 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:29,471 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:17:29,471 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:29,471 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:17:29,471 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:29,471 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:17:29,471 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:17:29,471 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:29,471 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:29,476 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:17:29,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:17:29,477 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:29,477 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:17:29,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:17:29,477 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:17:29,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:17:29,478 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:17:29,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:17:29,513 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:29,614 DEBUG [Listener at jenkins-hbase20.apache.org/34497] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 07:17:29,615 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-13 07:17:29,615 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-13 07:17:29,616 DEBUG [Listener at jenkins-hbase20.apache.org/34497] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-13 07:17:29,916 DEBUG [Listener at jenkins-hbase20.apache.org/34497] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 07:17:29,917 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-13 07:17:29,917 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-13 07:17:29,917 DEBUG [Listener at jenkins-hbase20.apache.org/34497] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-13 07:17:29,950 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-13 07:17:29,950 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:29,950 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:29,950 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689232649309Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689232649471 (+162 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1689232649471Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1689232649481 (+10 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689232649506 (+25 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689232649950 (+444 ms) 2023-07-13 07:17:29,953 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-13 07:17:29,954 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 642 msec 2023-07-13 07:17:30,417 DEBUG [Listener at jenkins-hbase20.apache.org/34497] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 07:17:30,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-13 07:17:30,419 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-13 07:17:30,419 INFO [Listener at jenkins-hbase20.apache.org/34497] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/export-test/export-1689232650419 2023-07-13 07:17:30,419 INFO [Listener at jenkins-hbase20.apache.org/34497] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost.localdomain:40681, tgtDir=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/export-test/export-1689232650419, rawTgtDir=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/export-test/export-1689232650419, srcFsUri=hdfs://localhost.localdomain:40681, srcDir=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e 2023-07-13 07:17:30,449 DEBUG [Listener at jenkins-hbase20.apache.org/34497] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost.localdomain:40681, inputRoot=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e 2023-07-13 07:17:30,449 DEBUG [Listener at jenkins-hbase20.apache.org/34497] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-73584122_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/export-test/export-1689232650419, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/export-test/export-1689232650419/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:30,449 INFO [Listener at jenkins-hbase20.apache.org/34497] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost.localdomain:40681, inputRoot=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e, snapshotDir=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-07-13 07:17:30,464 INFO [Listener at jenkins-hbase20.apache.org/34497] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/export-test/export-1689232650419/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:30,497 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-13 07:17:30,498 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-13 07:17:30,498 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-13 07:17:30,499 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-13 07:17:30,499 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-13 07:17:30,500 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-13 07:17:30,500 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-13 07:17:30,573 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a827846-4542-2630-0c34-c6bc20d13d68/hadoop-7528405801384237322.jar 2023-07-13 07:17:30,574 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-13 07:17:30,574 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-13 07:17:30,575 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-13 07:17:30,575 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-13 07:17:30,575 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-13 07:17:30,576 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-13 07:17:30,576 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-13 07:17:30,576 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-13 07:17:30,577 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-13 07:17:30,577 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-13 07:17:30,578 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-13 07:17:30,578 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-13 07:17:30,578 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-13 07:17:30,579 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-13 07:17:30,579 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-13 07:17:30,579 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-13 07:17:30,580 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-13 07:17:30,580 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-13 07:17:30,581 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-13 07:17:30,581 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-13 07:17:30,581 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-13 07:17:30,581 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-13 07:17:30,582 DEBUG [Listener at jenkins-hbase20.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-13 07:17:31,407 WARN [Listener at jenkins-hbase20.apache.org/34497] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-13 07:17:31,410 INFO [Listener at jenkins-hbase20.apache.org/34497] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-07-13 07:17:31,412 DEBUG [Listener at jenkins-hbase20.apache.org/34497] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-13 07:17:32,198 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-13 07:17:32,198 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-13 07:17:32,204 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689232548306_0006_000001 (auth:SIMPLE) 2023-07-13 07:17:32,247 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689232548306_0007_000001 (auth:SIMPLE) 2023-07-13 07:17:33,516 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-13 07:17:36,749 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689232548306_0007_000001 (auth:SIMPLE) 2023-07-13 07:17:39,013 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689232548306_0007_000001 (auth:SIMPLE) 2023-07-13 07:17:42,181 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689232548306_0007_000001 (auth:SIMPLE) 2023-07-13 07:17:43,650 INFO [Listener at jenkins-hbase20.apache.org/34497] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-13 07:17:43,650 INFO [Listener at jenkins-hbase20.apache.org/34497] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-13 07:17:43,656 INFO [Listener at jenkins-hbase20.apache.org/34497] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:43,657 INFO [Listener at jenkins-hbase20.apache.org/34497] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-13 07:17:43,657 INFO [Listener at jenkins-hbase20.apache.org/34497] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-13 07:17:43,657 DEBUG [Listener at jenkins-hbase20.apache.org/34497] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_139625932_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:43,658 DEBUG [Listener at jenkins-hbase20.apache.org/34497] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-13 07:17:43,658 DEBUG [Listener at jenkins-hbase20.apache.org/34497] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-13 07:17:43,658 DEBUG [Listener at jenkins-hbase20.apache.org/34497] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_139625932_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/export-test/export-1689232650419/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/export-test/export-1689232650419/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:43,658 DEBUG [Listener at jenkins-hbase20.apache.org/34497] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/export-test/export-1689232650419/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-13 07:17:43,658 DEBUG [Listener at jenkins-hbase20.apache.org/34497] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/export-test/export-1689232650419/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-13 07:17:43,664 INFO [Listener at jenkins-hbase20.apache.org/34497] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:43,664 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testtb-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:43,665 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] procedure2.ProcedureExecutor(1029): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:43,668 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-13 07:17:43,668 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689232663668"}]},"ts":"1689232663668"} 2023-07-13 07:17:43,669 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-07-13 07:17:43,670 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-07-13 07:17:43,671 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=b3b6fc2ea072cf4a8ce8c9b729845756, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=c4dddc8cbb0984cdfd6dfbaf671e8834, UNASSIGN}] 2023-07-13 07:17:43,673 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=b3b6fc2ea072cf4a8ce8c9b729845756, UNASSIGN 2023-07-13 07:17:43,674 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=c4dddc8cbb0984cdfd6dfbaf671e8834, UNASSIGN 2023-07-13 07:17:43,674 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=c4dddc8cbb0984cdfd6dfbaf671e8834, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:17:43,674 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=b3b6fc2ea072cf4a8ce8c9b729845756, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:17:43,674 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689232648236.c4dddc8cbb0984cdfd6dfbaf671e8834.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689232663674"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689232663674"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689232663674"}]},"ts":"1689232663674"} 2023-07-13 07:17:43,674 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689232648236.b3b6fc2ea072cf4a8ce8c9b729845756.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689232663674"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689232663674"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689232663674"}]},"ts":"1689232663674"} 2023-07-13 07:17:43,676 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=116, state=RUNNABLE; CloseRegionProcedure c4dddc8cbb0984cdfd6dfbaf671e8834, server=jenkins-hbase20.apache.org,44607,1689232541504}] 2023-07-13 07:17:43,677 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=118, ppid=115, state=RUNNABLE; CloseRegionProcedure b3b6fc2ea072cf4a8ce8c9b729845756, server=jenkins-hbase20.apache.org,42807,1689232541407}] 2023-07-13 07:17:43,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-13 07:17:43,828 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close c4dddc8cbb0984cdfd6dfbaf671e8834 2023-07-13 07:17:43,828 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing c4dddc8cbb0984cdfd6dfbaf671e8834, disabling compactions & flushes 2023-07-13 07:17:43,828 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689232648236.c4dddc8cbb0984cdfd6dfbaf671e8834. 2023-07-13 07:17:43,828 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689232648236.c4dddc8cbb0984cdfd6dfbaf671e8834. 2023-07-13 07:17:43,828 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689232648236.c4dddc8cbb0984cdfd6dfbaf671e8834. after waiting 0 ms 2023-07-13 07:17:43,828 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689232648236.c4dddc8cbb0984cdfd6dfbaf671e8834. 2023-07-13 07:17:43,833 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close b3b6fc2ea072cf4a8ce8c9b729845756 2023-07-13 07:17:43,833 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing b3b6fc2ea072cf4a8ce8c9b729845756, disabling compactions & flushes 2023-07-13 07:17:43,833 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689232648236.b3b6fc2ea072cf4a8ce8c9b729845756. 2023-07-13 07:17:43,833 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689232648236.b3b6fc2ea072cf4a8ce8c9b729845756. 2023-07-13 07:17:43,833 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689232648236.b3b6fc2ea072cf4a8ce8c9b729845756. after waiting 0 ms 2023-07-13 07:17:43,833 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689232648236.b3b6fc2ea072cf4a8ce8c9b729845756. 2023-07-13 07:17:43,841 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testExportFileSystemStateWithSkipTmp/c4dddc8cbb0984cdfd6dfbaf671e8834/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-13 07:17:43,841 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-13 07:17:43,842 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689232648236.c4dddc8cbb0984cdfd6dfbaf671e8834. 2023-07-13 07:17:43,842 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/default/testtb-testExportFileSystemStateWithSkipTmp/b3b6fc2ea072cf4a8ce8c9b729845756/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-13 07:17:43,842 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for c4dddc8cbb0984cdfd6dfbaf671e8834: 2023-07-13 07:17:43,843 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-13 07:17:43,844 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689232648236.b3b6fc2ea072cf4a8ce8c9b729845756. 2023-07-13 07:17:43,844 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for b3b6fc2ea072cf4a8ce8c9b729845756: 2023-07-13 07:17:43,845 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed c4dddc8cbb0984cdfd6dfbaf671e8834 2023-07-13 07:17:43,846 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=c4dddc8cbb0984cdfd6dfbaf671e8834, regionState=CLOSED 2023-07-13 07:17:43,846 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689232648236.c4dddc8cbb0984cdfd6dfbaf671e8834.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689232663846"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689232663846"}]},"ts":"1689232663846"} 2023-07-13 07:17:43,846 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed b3b6fc2ea072cf4a8ce8c9b729845756 2023-07-13 07:17:43,847 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=b3b6fc2ea072cf4a8ce8c9b729845756, regionState=CLOSED 2023-07-13 07:17:43,847 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689232648236.b3b6fc2ea072cf4a8ce8c9b729845756.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689232663847"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689232663847"}]},"ts":"1689232663847"} 2023-07-13 07:17:43,849 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=117, resume processing ppid=116 2023-07-13 07:17:43,849 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=116, state=SUCCESS; CloseRegionProcedure c4dddc8cbb0984cdfd6dfbaf671e8834, server=jenkins-hbase20.apache.org,44607,1689232541504 in 171 msec 2023-07-13 07:17:43,850 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=118, resume processing ppid=115 2023-07-13 07:17:43,850 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=115, state=SUCCESS; CloseRegionProcedure b3b6fc2ea072cf4a8ce8c9b729845756, server=jenkins-hbase20.apache.org,42807,1689232541407 in 171 msec 2023-07-13 07:17:43,850 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=c4dddc8cbb0984cdfd6dfbaf671e8834, UNASSIGN in 178 msec 2023-07-13 07:17:43,851 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=115, resume processing ppid=114 2023-07-13 07:17:43,852 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=b3b6fc2ea072cf4a8ce8c9b729845756, UNASSIGN in 179 msec 2023-07-13 07:17:43,852 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689232663852"}]},"ts":"1689232663852"} 2023-07-13 07:17:43,854 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-07-13 07:17:43,855 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-07-13 07:17:43,856 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 191 msec 2023-07-13 07:17:43,970 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-13 07:17:43,971 INFO [Listener at jenkins-hbase20.apache.org/34497] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-07-13 07:17:43,971 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.HMaster$5(2228): Client=jenkins//148.251.75.209 delete testtb-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:43,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] procedure2.ProcedureExecutor(1029): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:43,974 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:43,975 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:43,975 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:43,976 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44607] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:43,978 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:43,978 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:43,978 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:43,978 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:43,978 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-13 07:17:43,978 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-13 07:17:43,978 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-13 07:17:43,979 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:43,979 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 07:17:43,979 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 07:17:43,979 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:43,979 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data null 2023-07-13 07:17:43,979 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-13 07:17:43,979 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:43,979 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 07:17:43,979 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 07:17:43,980 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/b3b6fc2ea072cf4a8ce8c9b729845756 2023-07-13 07:17:43,980 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-13 07:17:43,980 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c4dddc8cbb0984cdfd6dfbaf671e8834 2023-07-13 07:17:43,981 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/b3b6fc2ea072cf4a8ce8c9b729845756/cf, FileablePath, hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/b3b6fc2ea072cf4a8ce8c9b729845756/recovered.edits] 2023-07-13 07:17:43,981 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c4dddc8cbb0984cdfd6dfbaf671e8834/cf, FileablePath, hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c4dddc8cbb0984cdfd6dfbaf671e8834/recovered.edits] 2023-07-13 07:17:43,984 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/b3b6fc2ea072cf4a8ce8c9b729845756/cf/c55ec2e934de4649b9511b6c1e0e28a8 to hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/b3b6fc2ea072cf4a8ce8c9b729845756/cf/c55ec2e934de4649b9511b6c1e0e28a8 2023-07-13 07:17:43,984 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c4dddc8cbb0984cdfd6dfbaf671e8834/cf/c512df41c7c442eaaea74d225cc2648a to hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/c4dddc8cbb0984cdfd6dfbaf671e8834/cf/c512df41c7c442eaaea74d225cc2648a 2023-07-13 07:17:43,987 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/b3b6fc2ea072cf4a8ce8c9b729845756/recovered.edits/9.seqid to hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/b3b6fc2ea072cf4a8ce8c9b729845756/recovered.edits/9.seqid 2023-07-13 07:17:43,987 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c4dddc8cbb0984cdfd6dfbaf671e8834/recovered.edits/9.seqid to hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/c4dddc8cbb0984cdfd6dfbaf671e8834/recovered.edits/9.seqid 2023-07-13 07:17:43,987 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/b3b6fc2ea072cf4a8ce8c9b729845756 2023-07-13 07:17:43,987 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c4dddc8cbb0984cdfd6dfbaf671e8834 2023-07-13 07:17:43,987 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-13 07:17:43,989 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:43,991 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-07-13 07:17:43,993 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-07-13 07:17:43,995 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:43,995 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-07-13 07:17:43,995 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689232648236.b3b6fc2ea072cf4a8ce8c9b729845756.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689232663995"}]},"ts":"9223372036854775807"} 2023-07-13 07:17:43,995 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689232648236.c4dddc8cbb0984cdfd6dfbaf671e8834.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689232663995"}]},"ts":"9223372036854775807"} 2023-07-13 07:17:43,997 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-13 07:17:43,997 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => b3b6fc2ea072cf4a8ce8c9b729845756, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689232648236.b3b6fc2ea072cf4a8ce8c9b729845756.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => c4dddc8cbb0984cdfd6dfbaf671e8834, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689232648236.c4dddc8cbb0984cdfd6dfbaf671e8834.', STARTKEY => '1', ENDKEY => ''}] 2023-07-13 07:17:43,997 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-07-13 07:17:43,997 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689232663997"}]},"ts":"9223372036854775807"} 2023-07-13 07:17:43,998 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-07-13 07:17:44,000 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:44,001 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 28 msec 2023-07-13 07:17:44,081 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-13 07:17:44,081 INFO [Listener at jenkins-hbase20.apache.org/34497] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-07-13 07:17:44,087 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-13 07:17:44,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:44,091 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-13 07:17:44,093 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37475] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:17:44,119 INFO [Listener at jenkins-hbase20.apache.org/34497] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=767 (was 763) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_139625932_17 at /127.0.0.1:54200 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (788891943) connection to jenkins-hbase20.apache.org/148.251.75.209:35879 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ApplicationMasterLauncher #12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0xd7981d0-shared-pool-42 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0xd7981d0-shared-pool-44 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_139625932_17 at /127.0.0.1:36516 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0xd7981d0-shared-pool-41 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0xd7981d0-shared-pool-43 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-5434 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_649772250_1 at /127.0.0.1:54180 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=915 (was 935), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=499 (was 509), ProcessCount=170 (was 170), AvailableMemoryMB=2956 (was 2948) - AvailableMemoryMB LEAK? - 2023-07-13 07:17:44,120 WARN [Listener at jenkins-hbase20.apache.org/34497] hbase.ResourceChecker(130): Thread=767 is superior to 500 2023-07-13 07:17:44,120 INFO [Listener at jenkins-hbase20.apache.org/34497] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-07-13 07:17:44,132 INFO [Listener at jenkins-hbase20.apache.org/34497] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase20.apache.org:0 2023-07-13 07:17:48,375 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689232548306_0007_000001 (auth:SIMPLE) 2023-07-13 07:17:49,411 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-13 07:17:58,261 INFO [Listener at jenkins-hbase20.apache.org/34497] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase20.apache.org:0 2023-07-13 07:18:12,388 ERROR [Thread[Thread-409,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-13 07:18:12,388 INFO [Listener at jenkins-hbase20.apache.org/34497] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase20.apache.org:0 2023-07-13 07:18:12,498 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-07-13 07:18:12,506 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-07-13 07:18:12,507 ERROR [Thread[Thread-419,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-13 07:18:12,515 INFO [Listener at jenkins-hbase20.apache.org/34497] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase20.apache.org:0 2023-07-13 07:18:12,619 ERROR [Thread[Thread-384,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-13 07:18:12,619 INFO [Listener at jenkins-hbase20.apache.org/34497] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-07-13 07:18:12,619 INFO [Listener at jenkins-hbase20.apache.org/34497] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-13 07:18:12,620 INFO [Listener at jenkins-hbase20.apache.org/34497] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-13 07:18:12,620 DEBUG [Listener at jenkins-hbase20.apache.org/34497] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2f7ef0ac to 127.0.0.1:58099 2023-07-13 07:18:12,620 DEBUG [Listener at jenkins-hbase20.apache.org/34497] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 07:18:12,620 DEBUG [Listener at jenkins-hbase20.apache.org/34497] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-13 07:18:12,620 DEBUG [Listener at jenkins-hbase20.apache.org/34497] util.JVMClusterUtil(257): Found active master hash=2029488341, stopped=false 2023-07-13 07:18:12,621 DEBUG [Listener at jenkins-hbase20.apache.org/34497] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-13 07:18:12,621 DEBUG [Listener at jenkins-hbase20.apache.org/34497] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-13 07:18:12,621 INFO [Listener at jenkins-hbase20.apache.org/34497] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase20.apache.org,37475,1689232540263 2023-07-13 07:18:12,622 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-13 07:18:12,622 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-13 07:18:12,622 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-13 07:18:12,622 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-13 07:18:12,622 INFO [Listener at jenkins-hbase20.apache.org/34497] procedure2.ProcedureExecutor(629): Stopping 2023-07-13 07:18:12,622 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-13 07:18:12,622 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-13 07:18:12,623 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-13 07:18:12,623 DEBUG [Listener at jenkins-hbase20.apache.org/34497] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5b63f268 to 127.0.0.1:58099 2023-07-13 07:18:12,623 DEBUG [Listener at jenkins-hbase20.apache.org/34497] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 07:18:12,623 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-13 07:18:12,623 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-13 07:18:12,624 INFO [Listener at jenkins-hbase20.apache.org/34497] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase20.apache.org,42807,1689232541407' ***** 2023-07-13 07:18:12,624 DEBUG [Listener at jenkins-hbase20.apache.org/34497] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-13 07:18:12,624 INFO [Listener at jenkins-hbase20.apache.org/34497] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-13 07:18:12,624 INFO [Listener at jenkins-hbase20.apache.org/34497] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase20.apache.org,44195,1689232541463' ***** 2023-07-13 07:18:12,624 DEBUG [Listener at jenkins-hbase20.apache.org/34497] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-13 07:18:12,624 INFO [RS:0;jenkins-hbase20:42807] regionserver.HeapMemoryManager(220): Stopping 2023-07-13 07:18:12,624 INFO [Listener at jenkins-hbase20.apache.org/34497] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-13 07:18:12,625 INFO [Listener at jenkins-hbase20.apache.org/34497] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase20.apache.org,44607,1689232541504' ***** 2023-07-13 07:18:12,625 INFO [RS:0;jenkins-hbase20:42807] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-13 07:18:12,625 INFO [RS:1;jenkins-hbase20:44195] regionserver.HeapMemoryManager(220): Stopping 2023-07-13 07:18:12,625 INFO [RS:0;jenkins-hbase20:42807] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-13 07:18:12,625 DEBUG [Listener at jenkins-hbase20.apache.org/34497] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-13 07:18:12,625 INFO [RS:0;jenkins-hbase20:42807] regionserver.HRegionServer(1144): stopping server jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:18:12,625 INFO [Listener at jenkins-hbase20.apache.org/34497] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-13 07:18:12,625 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-13 07:18:12,625 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-13 07:18:12,625 INFO [RS:1;jenkins-hbase20:44195] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-13 07:18:12,625 INFO [RS:2;jenkins-hbase20:44607] regionserver.HeapMemoryManager(220): Stopping 2023-07-13 07:18:12,625 DEBUG [RS:0;jenkins-hbase20:42807] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0fa2ec23 to 127.0.0.1:58099 2023-07-13 07:18:12,625 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-13 07:18:12,625 INFO [RS:2;jenkins-hbase20:44607] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-13 07:18:12,625 INFO [RS:1;jenkins-hbase20:44195] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-13 07:18:12,626 INFO [RS:2;jenkins-hbase20:44607] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-13 07:18:12,626 INFO [RS:1;jenkins-hbase20:44195] regionserver.HRegionServer(1144): stopping server jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:18:12,626 DEBUG [RS:0;jenkins-hbase20:42807] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 07:18:12,626 DEBUG [RS:1;jenkins-hbase20:44195] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x26926280 to 127.0.0.1:58099 2023-07-13 07:18:12,629 INFO [RS:0;jenkins-hbase20:42807] regionserver.HRegionServer(1170): stopping server jenkins-hbase20.apache.org,42807,1689232541407; all regions closed. 2023-07-13 07:18:12,629 DEBUG [RS:1;jenkins-hbase20:44195] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 07:18:12,629 INFO [RS:2;jenkins-hbase20:44607] regionserver.HRegionServer(3305): Received CLOSE for a2bac6de91a657b465094c198afccca7 2023-07-13 07:18:12,629 INFO [RS:1;jenkins-hbase20:44195] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-13 07:18:12,629 INFO [RS:1;jenkins-hbase20:44195] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-13 07:18:12,629 INFO [RS:1;jenkins-hbase20:44195] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-13 07:18:12,630 INFO [RS:1;jenkins-hbase20:44195] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-13 07:18:12,630 INFO [RS:2;jenkins-hbase20:44607] regionserver.HRegionServer(3305): Received CLOSE for 3a0868eccd6b479e990b6482c6f4f5de 2023-07-13 07:18:12,630 INFO [RS:2;jenkins-hbase20:44607] regionserver.HRegionServer(1144): stopping server jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:18:12,630 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing a2bac6de91a657b465094c198afccca7, disabling compactions & flushes 2023-07-13 07:18:12,630 INFO [RS:1;jenkins-hbase20:44195] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-13 07:18:12,631 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689232544705.a2bac6de91a657b465094c198afccca7. 2023-07-13 07:18:12,630 DEBUG [RS:2;jenkins-hbase20:44607] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3c1664ca to 127.0.0.1:58099 2023-07-13 07:18:12,631 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689232544705.a2bac6de91a657b465094c198afccca7. 2023-07-13 07:18:12,631 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689232544705.a2bac6de91a657b465094c198afccca7. after waiting 0 ms 2023-07-13 07:18:12,631 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689232544705.a2bac6de91a657b465094c198afccca7. 2023-07-13 07:18:12,631 DEBUG [RS:1;jenkins-hbase20:44195] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-07-13 07:18:12,631 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing a2bac6de91a657b465094c198afccca7 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-07-13 07:18:12,631 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-13 07:18:12,631 DEBUG [RS:2;jenkins-hbase20:44607] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 07:18:12,632 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-13 07:18:12,632 INFO [RS:2;jenkins-hbase20:44607] regionserver.HRegionServer(1474): Waiting on 2 regions to close 2023-07-13 07:18:12,632 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-13 07:18:12,632 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-13 07:18:12,632 DEBUG [RS:2;jenkins-hbase20:44607] regionserver.HRegionServer(1478): Online Regions={a2bac6de91a657b465094c198afccca7=hbase:acl,,1689232544705.a2bac6de91a657b465094c198afccca7., 3a0868eccd6b479e990b6482c6f4f5de=hbase:namespace,,1689232543840.3a0868eccd6b479e990b6482c6f4f5de.} 2023-07-13 07:18:12,633 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-13 07:18:12,633 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.97 KB heapSize=71.98 KB 2023-07-13 07:18:12,633 DEBUG [RS:1;jenkins-hbase20:44195] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-13 07:18:12,633 DEBUG [RS:2;jenkins-hbase20:44607] regionserver.HRegionServer(1504): Waiting on 3a0868eccd6b479e990b6482c6f4f5de, a2bac6de91a657b465094c198afccca7 2023-07-13 07:18:12,652 DEBUG [RS:0;jenkins-hbase20:42807] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/oldWALs 2023-07-13 07:18:12,652 INFO [RS:0;jenkins-hbase20:42807] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C42807%2C1689232541407:(num 1689232543322) 2023-07-13 07:18:12,652 DEBUG [RS:0;jenkins-hbase20:42807] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 07:18:12,654 INFO [RS:0;jenkins-hbase20:42807] regionserver.LeaseManager(133): Closed leases 2023-07-13 07:18:12,654 INFO [RS:0;jenkins-hbase20:42807] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase20:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-13 07:18:12,655 INFO [RS:0;jenkins-hbase20:42807] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-13 07:18:12,655 INFO [regionserver/jenkins-hbase20:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-13 07:18:12,655 INFO [RS:0;jenkins-hbase20:42807] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-13 07:18:12,657 INFO [RS:0;jenkins-hbase20:42807] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-13 07:18:12,659 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/hbase/acl/a2bac6de91a657b465094c198afccca7/.tmp/l/6d8496390663446c940e289365bff8bc 2023-07-13 07:18:12,659 INFO [RS:0;jenkins-hbase20:42807] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:42807 2023-07-13 07:18:12,666 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:18:12,666 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:18:12,666 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-13 07:18:12,666 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-13 07:18:12,666 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,42807,1689232541407 2023-07-13 07:18:12,666 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-13 07:18:12,667 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-13 07:18:12,668 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase20.apache.org,42807,1689232541407] 2023-07-13 07:18:12,669 INFO [regionserver/jenkins-hbase20:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-13 07:18:12,672 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase20.apache.org,42807,1689232541407; numProcessing=1 2023-07-13 07:18:12,673 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6d8496390663446c940e289365bff8bc 2023-07-13 07:18:12,673 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/hbase/meta/1588230740/.tmp/info/d6fad20791364c45a7870e75811016bc 2023-07-13 07:18:12,673 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/hbase/acl/a2bac6de91a657b465094c198afccca7/.tmp/l/6d8496390663446c940e289365bff8bc as hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/hbase/acl/a2bac6de91a657b465094c198afccca7/l/6d8496390663446c940e289365bff8bc 2023-07-13 07:18:12,678 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6d8496390663446c940e289365bff8bc 2023-07-13 07:18:12,678 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/hbase/acl/a2bac6de91a657b465094c198afccca7/l/6d8496390663446c940e289365bff8bc, entries=7, sequenceid=18, filesize=5.2 K 2023-07-13 07:18:12,679 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d6fad20791364c45a7870e75811016bc 2023-07-13 07:18:12,679 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for a2bac6de91a657b465094c198afccca7 in 48ms, sequenceid=18, compaction requested=false 2023-07-13 07:18:12,682 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase20.apache.org,42807,1689232541407 already deleted, retry=false 2023-07-13 07:18:12,682 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase20.apache.org,42807,1689232541407 expired; onlineServers=2 2023-07-13 07:18:12,683 INFO [regionserver/jenkins-hbase20:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-13 07:18:12,687 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/hbase/acl/a2bac6de91a657b465094c198afccca7/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-07-13 07:18:12,688 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-13 07:18:12,689 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1689232544705.a2bac6de91a657b465094c198afccca7. 2023-07-13 07:18:12,689 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for a2bac6de91a657b465094c198afccca7: 2023-07-13 07:18:12,689 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1689232544705.a2bac6de91a657b465094c198afccca7. 2023-07-13 07:18:12,690 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 3a0868eccd6b479e990b6482c6f4f5de, disabling compactions & flushes 2023-07-13 07:18:12,690 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689232543840.3a0868eccd6b479e990b6482c6f4f5de. 2023-07-13 07:18:12,690 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689232543840.3a0868eccd6b479e990b6482c6f4f5de. 2023-07-13 07:18:12,690 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689232543840.3a0868eccd6b479e990b6482c6f4f5de. after waiting 0 ms 2023-07-13 07:18:12,690 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689232543840.3a0868eccd6b479e990b6482c6f4f5de. 2023-07-13 07:18:12,690 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing 3a0868eccd6b479e990b6482c6f4f5de 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-13 07:18:12,693 INFO [regionserver/jenkins-hbase20:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-13 07:18:12,718 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/hbase/meta/1588230740/.tmp/rep_barrier/19b5dcfd59e348f0a0407e5b09c7dd62 2023-07-13 07:18:12,725 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 19b5dcfd59e348f0a0407e5b09c7dd62 2023-07-13 07:18:12,727 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/hbase/namespace/3a0868eccd6b479e990b6482c6f4f5de/.tmp/info/06327f9d4b1c4316849749b9e1432a5d 2023-07-13 07:18:12,734 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/hbase/namespace/3a0868eccd6b479e990b6482c6f4f5de/.tmp/info/06327f9d4b1c4316849749b9e1432a5d as hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/hbase/namespace/3a0868eccd6b479e990b6482c6f4f5de/info/06327f9d4b1c4316849749b9e1432a5d 2023-07-13 07:18:12,740 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/hbase/namespace/3a0868eccd6b479e990b6482c6f4f5de/info/06327f9d4b1c4316849749b9e1432a5d, entries=2, sequenceid=6, filesize=4.8 K 2023-07-13 07:18:12,741 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 3a0868eccd6b479e990b6482c6f4f5de in 51ms, sequenceid=6, compaction requested=false 2023-07-13 07:18:12,761 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/hbase/meta/1588230740/.tmp/table/3ac690726e0049d9b61fecbcfd015849 2023-07-13 07:18:12,762 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/hbase/namespace/3a0868eccd6b479e990b6482c6f4f5de/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-13 07:18:12,762 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-13 07:18:12,763 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689232543840.3a0868eccd6b479e990b6482c6f4f5de. 2023-07-13 07:18:12,763 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 3a0868eccd6b479e990b6482c6f4f5de: 2023-07-13 07:18:12,764 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1689232543840.3a0868eccd6b479e990b6482c6f4f5de. 2023-07-13 07:18:12,766 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3ac690726e0049d9b61fecbcfd015849 2023-07-13 07:18:12,767 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/hbase/meta/1588230740/.tmp/info/d6fad20791364c45a7870e75811016bc as hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/hbase/meta/1588230740/info/d6fad20791364c45a7870e75811016bc 2023-07-13 07:18:12,769 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-13 07:18:12,769 INFO [RS:0;jenkins-hbase20:42807] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase20.apache.org,42807,1689232541407; zookeeper connection closed. 2023-07-13 07:18:12,769 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:42807-0x100852f7ac90001, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-13 07:18:12,769 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@5ac0d65c] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@5ac0d65c 2023-07-13 07:18:12,770 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d6fad20791364c45a7870e75811016bc 2023-07-13 07:18:12,771 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/hbase/meta/1588230740/info/d6fad20791364c45a7870e75811016bc, entries=48, sequenceid=131, filesize=10.3 K 2023-07-13 07:18:12,771 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/hbase/meta/1588230740/.tmp/rep_barrier/19b5dcfd59e348f0a0407e5b09c7dd62 as hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/hbase/meta/1588230740/rep_barrier/19b5dcfd59e348f0a0407e5b09c7dd62 2023-07-13 07:18:12,778 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 19b5dcfd59e348f0a0407e5b09c7dd62 2023-07-13 07:18:12,778 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/hbase/meta/1588230740/rep_barrier/19b5dcfd59e348f0a0407e5b09c7dd62, entries=13, sequenceid=131, filesize=6.4 K 2023-07-13 07:18:12,779 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/hbase/meta/1588230740/.tmp/table/3ac690726e0049d9b61fecbcfd015849 as hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/hbase/meta/1588230740/table/3ac690726e0049d9b61fecbcfd015849 2023-07-13 07:18:12,786 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3ac690726e0049d9b61fecbcfd015849 2023-07-13 07:18:12,786 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/hbase/meta/1588230740/table/3ac690726e0049d9b61fecbcfd015849, entries=24, sequenceid=131, filesize=6.9 K 2023-07-13 07:18:12,787 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.97 KB/47078, heapSize ~71.93 KB/73656, currentSize=0 B/0 for 1588230740 in 154ms, sequenceid=131, compaction requested=false 2023-07-13 07:18:12,806 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-07-13 07:18:12,806 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-13 07:18:12,806 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-13 07:18:12,807 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-13 07:18:12,807 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-13 07:18:12,808 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-13 07:18:12,833 INFO [RS:1;jenkins-hbase20:44195] regionserver.HRegionServer(1170): stopping server jenkins-hbase20.apache.org,44195,1689232541463; all regions closed. 2023-07-13 07:18:12,833 INFO [RS:2;jenkins-hbase20:44607] regionserver.HRegionServer(1170): stopping server jenkins-hbase20.apache.org,44607,1689232541504; all regions closed. 2023-07-13 07:18:12,851 DEBUG [RS:2;jenkins-hbase20:44607] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/oldWALs 2023-07-13 07:18:12,852 INFO [RS:2;jenkins-hbase20:44607] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C44607%2C1689232541504:(num 1689232543324) 2023-07-13 07:18:12,852 DEBUG [RS:2;jenkins-hbase20:44607] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 07:18:12,852 DEBUG [RS:1;jenkins-hbase20:44195] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/oldWALs 2023-07-13 07:18:12,852 INFO [RS:2;jenkins-hbase20:44607] regionserver.LeaseManager(133): Closed leases 2023-07-13 07:18:12,852 INFO [RS:1;jenkins-hbase20:44195] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C44195%2C1689232541463.meta:.meta(num 1689232543514) 2023-07-13 07:18:12,852 INFO [RS:2;jenkins-hbase20:44607] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase20:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-13 07:18:12,853 INFO [RS:2;jenkins-hbase20:44607] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-13 07:18:12,853 INFO [regionserver/jenkins-hbase20:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-13 07:18:12,853 INFO [RS:2;jenkins-hbase20:44607] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-13 07:18:12,853 INFO [RS:2;jenkins-hbase20:44607] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-13 07:18:12,854 INFO [RS:2;jenkins-hbase20:44607] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:44607 2023-07-13 07:18:12,859 DEBUG [RS:1;jenkins-hbase20:44195] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/oldWALs 2023-07-13 07:18:12,859 INFO [RS:1;jenkins-hbase20:44195] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C44195%2C1689232541463:(num 1689232543322) 2023-07-13 07:18:12,859 DEBUG [RS:1;jenkins-hbase20:44195] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 07:18:12,859 INFO [RS:1;jenkins-hbase20:44195] regionserver.LeaseManager(133): Closed leases 2023-07-13 07:18:12,859 INFO [RS:1;jenkins-hbase20:44195] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase20:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-13 07:18:12,860 INFO [regionserver/jenkins-hbase20:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-13 07:18:12,860 INFO [RS:1;jenkins-hbase20:44195] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:44195 2023-07-13 07:18:13,088 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-13 07:18:13,088 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:18:13,088 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,44607,1689232541504 2023-07-13 07:18:13,091 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:18:13,091 ERROR [Listener at localhost.localdomain/37489-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3f413f9 rejected from java.util.concurrent.ThreadPoolExecutor@7cb975f[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 112] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1374) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:603) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-07-13 07:18:13,093 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,44195,1689232541463 2023-07-13 07:18:13,094 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase20.apache.org,44195,1689232541463] 2023-07-13 07:18:13,094 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase20.apache.org,44195,1689232541463; numProcessing=2 2023-07-13 07:18:13,096 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase20.apache.org,44195,1689232541463 already deleted, retry=false 2023-07-13 07:18:13,096 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase20.apache.org,44195,1689232541463 expired; onlineServers=1 2023-07-13 07:18:13,096 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase20.apache.org,44607,1689232541504] 2023-07-13 07:18:13,096 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase20.apache.org,44607,1689232541504; numProcessing=3 2023-07-13 07:18:13,098 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase20.apache.org,44607,1689232541504 already deleted, retry=false 2023-07-13 07:18:13,098 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase20.apache.org,44607,1689232541504 expired; onlineServers=0 2023-07-13 07:18:13,098 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase20.apache.org,37475,1689232540263' ***** 2023-07-13 07:18:13,098 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-13 07:18:13,099 DEBUG [M:0;jenkins-hbase20:37475] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@39ca82ee, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-07-13 07:18:13,099 INFO [M:0;jenkins-hbase20:37475] regionserver.HRegionServer(1144): stopping server jenkins-hbase20.apache.org,37475,1689232540263 2023-07-13 07:18:13,099 INFO [M:0;jenkins-hbase20:37475] regionserver.HRegionServer(1170): stopping server jenkins-hbase20.apache.org,37475,1689232540263; all regions closed. 2023-07-13 07:18:13,099 DEBUG [M:0;jenkins-hbase20:37475] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 07:18:13,099 DEBUG [M:0;jenkins-hbase20:37475] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-13 07:18:13,099 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-13 07:18:13,099 DEBUG [M:0;jenkins-hbase20:37475] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-13 07:18:13,100 INFO [M:0;jenkins-hbase20:37475] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-13 07:18:13,100 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1689232542909] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1689232542909,5,FailOnTimeoutGroup] 2023-07-13 07:18:13,100 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1689232542909] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1689232542909,5,FailOnTimeoutGroup] 2023-07-13 07:18:13,100 INFO [M:0;jenkins-hbase20:37475] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-13 07:18:13,103 INFO [M:0;jenkins-hbase20:37475] hbase.ChoreService(369): Chore service for: master/jenkins-hbase20:0 had [] on shutdown 2023-07-13 07:18:13,103 DEBUG [M:0;jenkins-hbase20:37475] master.HMaster(1512): Stopping service threads 2023-07-13 07:18:13,103 INFO [M:0;jenkins-hbase20:37475] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-13 07:18:13,103 ERROR [M:0;jenkins-hbase20:37475] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-13,5,PEWorkerGroup] Thread[HFileArchiver-15,5,PEWorkerGroup] 2023-07-13 07:18:13,103 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-13 07:18:13,103 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-13 07:18:13,104 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-13 07:18:13,104 INFO [M:0;jenkins-hbase20:37475] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-13 07:18:13,104 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-13 07:18:13,107 DEBUG [M:0;jenkins-hbase20:37475] zookeeper.ZKUtil(398): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-13 07:18:13,107 WARN [M:0;jenkins-hbase20:37475] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-13 07:18:13,107 INFO [M:0;jenkins-hbase20:37475] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-13 07:18:13,107 INFO [M:0;jenkins-hbase20:37475] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-13 07:18:13,108 DEBUG [M:0;jenkins-hbase20:37475] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-13 07:18:13,108 INFO [M:0;jenkins-hbase20:37475] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-13 07:18:13,108 DEBUG [M:0;jenkins-hbase20:37475] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-13 07:18:13,108 DEBUG [M:0;jenkins-hbase20:37475] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-13 07:18:13,108 DEBUG [M:0;jenkins-hbase20:37475] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-13 07:18:13,108 INFO [M:0;jenkins-hbase20:37475] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=373.32 KB heapSize=449.18 KB 2023-07-13 07:18:13,128 INFO [M:0;jenkins-hbase20:37475] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=373.32 KB at sequenceid=895 (bloomFilter=true), to=hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/563e1fe6f82f43e58982989f6c4eab11 2023-07-13 07:18:13,132 INFO [M:0;jenkins-hbase20:37475] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 563e1fe6f82f43e58982989f6c4eab11 2023-07-13 07:18:13,133 DEBUG [M:0;jenkins-hbase20:37475] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/563e1fe6f82f43e58982989f6c4eab11 as hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/563e1fe6f82f43e58982989f6c4eab11 2023-07-13 07:18:13,138 INFO [M:0;jenkins-hbase20:37475] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 563e1fe6f82f43e58982989f6c4eab11 2023-07-13 07:18:13,139 INFO [M:0;jenkins-hbase20:37475] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40681/user/jenkins/test-data/4ff3038e-702c-4690-eded-1ebe8db0549e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/563e1fe6f82f43e58982989f6c4eab11, entries=119, sequenceid=895, filesize=28.4 K 2023-07-13 07:18:13,139 INFO [M:0;jenkins-hbase20:37475] regionserver.HRegion(2948): Finished flush of dataSize ~373.32 KB/382280, heapSize ~449.16 KB/459944, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 31ms, sequenceid=895, compaction requested=false 2023-07-13 07:18:13,141 INFO [M:0;jenkins-hbase20:37475] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-13 07:18:13,141 DEBUG [M:0;jenkins-hbase20:37475] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-13 07:18:13,147 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-13 07:18:13,147 INFO [M:0;jenkins-hbase20:37475] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-13 07:18:13,148 INFO [M:0;jenkins-hbase20:37475] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:37475 2023-07-13 07:18:13,149 DEBUG [M:0;jenkins-hbase20:37475] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase20.apache.org,37475,1689232540263 already deleted, retry=false 2023-07-13 07:18:13,194 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-13 07:18:13,194 INFO [RS:2;jenkins-hbase20:44607] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase20.apache.org,44607,1689232541504; zookeeper connection closed. 2023-07-13 07:18:13,194 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44607-0x100852f7ac90003, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-13 07:18:13,194 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@769986cd] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@769986cd 2023-07-13 07:18:13,294 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-13 07:18:13,294 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): master:37475-0x100852f7ac90000, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-13 07:18:13,294 INFO [M:0;jenkins-hbase20:37475] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase20.apache.org,37475,1689232540263; zookeeper connection closed. 2023-07-13 07:18:13,394 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-13 07:18:13,394 DEBUG [Listener at localhost.localdomain/37489-EventThread] zookeeper.ZKWatcher(600): regionserver:44195-0x100852f7ac90002, quorum=127.0.0.1:58099, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-13 07:18:13,394 INFO [RS:1;jenkins-hbase20:44195] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase20.apache.org,44195,1689232541463; zookeeper connection closed. 2023-07-13 07:18:13,395 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@66680fd2] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@66680fd2 2023-07-13 07:18:13,395 INFO [Listener at jenkins-hbase20.apache.org/34497] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-07-13 07:18:13,396 WARN [Listener at jenkins-hbase20.apache.org/34497] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-13 07:18:13,401 INFO [Listener at jenkins-hbase20.apache.org/34497] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-13 07:18:13,508 WARN [BP-1473176178-148.251.75.209-1689232536107 heartbeating to localhost.localdomain/127.0.0.1:40681] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-13 07:18:13,508 WARN [BP-1473176178-148.251.75.209-1689232536107 heartbeating to localhost.localdomain/127.0.0.1:40681] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1473176178-148.251.75.209-1689232536107 (Datanode Uuid 1df9aed5-5032-4715-9b57-f6fb3996a0e6) service to localhost.localdomain/127.0.0.1:40681 2023-07-13 07:18:13,510 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a827846-4542-2630-0c34-c6bc20d13d68/cluster_bc2fa478-0401-934d-1612-4dd95a9869a4/dfs/data/data5/current/BP-1473176178-148.251.75.209-1689232536107] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-13 07:18:13,510 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a827846-4542-2630-0c34-c6bc20d13d68/cluster_bc2fa478-0401-934d-1612-4dd95a9869a4/dfs/data/data6/current/BP-1473176178-148.251.75.209-1689232536107] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-13 07:18:13,513 WARN [Listener at jenkins-hbase20.apache.org/34497] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-13 07:18:13,515 INFO [Listener at jenkins-hbase20.apache.org/34497] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-13 07:18:13,622 WARN [BP-1473176178-148.251.75.209-1689232536107 heartbeating to localhost.localdomain/127.0.0.1:40681] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-13 07:18:13,622 WARN [BP-1473176178-148.251.75.209-1689232536107 heartbeating to localhost.localdomain/127.0.0.1:40681] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1473176178-148.251.75.209-1689232536107 (Datanode Uuid 286df2f3-4adc-4591-ab09-d8a23e0418f1) service to localhost.localdomain/127.0.0.1:40681 2023-07-13 07:18:13,623 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a827846-4542-2630-0c34-c6bc20d13d68/cluster_bc2fa478-0401-934d-1612-4dd95a9869a4/dfs/data/data3/current/BP-1473176178-148.251.75.209-1689232536107] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-13 07:18:13,623 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a827846-4542-2630-0c34-c6bc20d13d68/cluster_bc2fa478-0401-934d-1612-4dd95a9869a4/dfs/data/data4/current/BP-1473176178-148.251.75.209-1689232536107] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-13 07:18:13,625 WARN [Listener at jenkins-hbase20.apache.org/34497] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-13 07:18:13,627 INFO [Listener at jenkins-hbase20.apache.org/34497] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-13 07:18:13,629 WARN [BP-1473176178-148.251.75.209-1689232536107 heartbeating to localhost.localdomain/127.0.0.1:40681] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-13 07:18:13,629 WARN [BP-1473176178-148.251.75.209-1689232536107 heartbeating to localhost.localdomain/127.0.0.1:40681] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1473176178-148.251.75.209-1689232536107 (Datanode Uuid 79248deb-0320-45b7-a508-b869baa20271) service to localhost.localdomain/127.0.0.1:40681 2023-07-13 07:18:13,630 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a827846-4542-2630-0c34-c6bc20d13d68/cluster_bc2fa478-0401-934d-1612-4dd95a9869a4/dfs/data/data1/current/BP-1473176178-148.251.75.209-1689232536107] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-13 07:18:13,630 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a827846-4542-2630-0c34-c6bc20d13d68/cluster_bc2fa478-0401-934d-1612-4dd95a9869a4/dfs/data/data2/current/BP-1473176178-148.251.75.209-1689232536107] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-13 07:18:13,649 INFO [Listener at jenkins-hbase20.apache.org/34497] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:0 2023-07-13 07:18:13,777 INFO [Listener at jenkins-hbase20.apache.org/34497] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-13 07:18:13,850 INFO [Listener at jenkins-hbase20.apache.org/34497] hbase.HBaseTestingUtility(1293): Minicluster is down